Kinect-Like Interface for your iPhone?

Friday, January 13, 2012

Yesterday the US Patent & Trademark Office published a patent application from Apple that reveals an exciting new 3D GUI for iOS mobile devices. The new UI will work with proximity sensor arrays and will respond to hovering gestures. The researchers in Cupertino have been working on advanced 3D GUIs for some time now. We first learned of a major 3D GUI project back in 2009 that involved using head tracking technology. Then in early 2010 we learned of Apple's first project relating to a 3D GUI for iOS devices. Later that year Apple 3D multifunctional widgets and over time revealed advanced 3D and hovering based gesturing for CAD users on an iPad. With twenty times the GPU power coming to iOS devices over the next year, Apple appears to paving the way for a new 3D GUI for mobile devices in the not-too-distant future.
Apple's latest invention is interesting. The invention discloses a 3D display environment for mobile device that uses orientation data from one or more onboard sensors to automatically determine and display a perspective projection of the 3D display environment based on the orientation data without the user physically interacting with (e.g., touching) the display. In some implementations, the display environment could be changed based on gestures made a distance above a touch sensitive display that incorporates proximity sensor arrays.

See the full breakdown of the patent at Patently Apple.

Patently Apple: