Nvidia Broadcast enables deepfake eye contact during video calls
Doing other "work" during the video call without losing eye contact? With the new Eye Contact function from Nvidia Broadcast, you can.
If your PC has an RTX graphics card from Nvidia, you can use the streaming software Broadcast. Its latest version 1.4 offers, among other things, a feature called Eye Contact, which uses artificial intelligence (AI). It replaces your eyes in real time using Deepfake and directs eye contact to the camera. The AI also tries to recognise and reproduce your eye colour.
Once activated, your eyes maintain contact with the person you are video calling. Even if you're fiddling with your smartphone or doing something else on the second screen. Nvidia says of the new function that it is intended for content creators who film themselves while reading notes or a script
However, Eye-Contact doesn't always work quite as well as in Nvidia's demonstration. For example, the generated eyes sometimes seem too nimble in their movement or somehow don't fit into the action. Apart from the fact that holding eye contact for a longer period of time can also cause displeasure in the other person.
The fact that not everything works smoothly yet may be due to the fact that the function is still in beta. Nvidia is also aware of this and is asking its Community members for feedback in video form. Nvidia wants to improve the function with content received via video upload and notes that there are millions of eye colours and lighting combinations
Apple and Microsoft also have similar functions for fake eye contact. Apple has integrated Eye Contact into FaceTime, while Microsoft has the function in Windows 11 - but it requires a Neural Processing Unit (NPU).
Cover image: Nvidia
I find my muse in everything. When I don’t, I draw inspiration from daydreaming. After all, if you dream, you don’t sleep through life.