(11-22-2020, 08:47 AM)vlbastos Wrote: Head tracking/face tracking/eye tracking 3D "stereoscopy" (in fact just off-axis projection) for Android Dolphin would be awesome. No need to render each eye, no resolution loss, no color loss, just a rendering trick that delivers nice 3D to a single user. Even Parallax 3D using the cellphone's sensors would be nice. Demos:
https://youtu.be/xjH8Q4xsKpo
https://youtu.be/h9kPI7_vhAU
Yes, this was suggested years ago by Johnny Lee and was even originally suggested it would come in as an easter egg to Boom Blox. Later, the Factor5 devs working on a Star Wars Rogue Squadron compilation title had plans to bring a similar head tracking piece of tech to that game and "We Fly". Unfortunately, none of those surfaced.
While my intention was not the 3d effect you mention, I was hoping to support flight sim type titles with head tracking (which is pretty common in PC games) using Dolphin's "Free Look". This is done in this PR and I attempted to use OpenTrack as a way to integrate (I haven't tested with the webcam method since I don't have such a device). There's some things blocking that to being merged (mainly a refactor of "Free Look").
It's not clear to me whether the 3d effect is just a by-product of the head tracking or if something else needs to happen to "enable it". If the above PRs get merged, it's something I'd be interested in looking into (if it doesn't work out of the box). Someone else would need to work on the Android logic, I'm not particularly interested in that. However, my guess is with the above PR, you could simply map to the phone's gyro.
EDIT: took a quick look and found some technical explanations. Once the above PRs get merged, I will definitely look into this.