Mark Zuckerberg, head honcho of the organisation formerly known as Facebook, has completed his first interview entirely conducted within his company's eponymous Metaverse. And it's sort of impressive, sort of unnerving and sort of meh, all rolled into one.
Zuckerberg hooked up with Lex Fridman for the interview, a podcaster by whom he has been interviewed on several previous occasions. Zuckerberg and Fridman were remotely located from one another, Fridman in Austin Texas and Zuckerberg presumably at Meta's California head office.
For the interview, both were subject to detailed physical scans and also some kind of facial expression and movement training process, perhaps akin to a more complex version of the training routines used to learn biometric data for smartphone security including fingerprints and faces.
Zuckerberg explains that this data is then collapsed into a codec which in turn is combined with sensor data from a VR headset to create a lifelike digital avatar. What's quite clever is that this codec approach means that the bandwidth required is relatively limited. Once each party has a copy of the other's digital avatar, the data required to animate them is much less than for, say, transmitting high definition digital video.
In theory, then, you have something much more realistic than video but for less bandwidth. But just how realistic? Up to a point, you can judge for yourself. Fridman has uploaded a 2D representation of the interview on his YouTube channel including both avatars.
Sadly, the video is only 1080p. But even at that relatively low resolution, it's possible to see that the avatars have a fairly unambiguous CGI vibe. They're good, for sure, but nobody even moderately familiar with modern CGI would
Read more on pcgamer.com