Apple AR Glasses to Offer an Advanced Hand Gesture User Interface and Object Detection

Apple’s long rumored AR headset is predicted to include multiple highly sensitive 3D sensing modules in order to offer an innovative hand gesture and object detecting user interface, according to Apple analyst Ming-Chi Kuo in a new research note obtained by MacRumors.

apple glasses concept macrumors

We predict that the structured light of the AR/MR headset can detect not only the position change of the user or other people’s hand and object in front of the user’s eyes but also the dynamic detail change of the hand (just like the iPhone’s Face ID/structured light/Animoji can detect user’s dynamic expression change). Capturing the details of hand movement can provide a more intuitive and vivid human-machine UI (for example, detecting the user’s hand from a clenched fist to open and the balloon [image] in hand flying away).

Kuo describes the ability for the headset to detect both hand gestures and movements to provide the user with an immersive experience where the user could open their hand to let go of a virtual balloon.

In order to accomplish this impressive feat, Apple is expected to incorporate four sets of 3D sensors which are of higher quality and specifications than the current iPhones. Kuo sees the quality of this human-machine user interface is key to the success of Apple’s upcoming AR headset. According to Kuo, these interface abilities include gesture control, object detection, as well as eye tracking, iris recognition, voice control, skin detection, expression detection, and spatial detection.

Earlier this year, Patently Apple pointed out a patent application from Apple which details this same concept.

Different movements and locations of the micro-gestures and various movement parameters are used to determine the operations that are performed in the three-dimensional environment. Using the cameras to capture the micro-gestures to interact with the three-dimensional environment allow the user to freely move about the physical environment without be encumbered by physical input equipment, which allows the user to explore the three-dimensional environment more naturally and efficiently.

That patient is titled “Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments”.

Popular Stories

Apple CEO Tim Cook ‘Secretly’ Signed $275 Billion Deal With China in 2016

Apple CEO Tim Cook “secretly” signed an agreement worth more than $275 billion with Chinese officials, promising that Apple would help to develop China’s economy and technological capabilities, The Information reports.
In an extensive paywalled report based on interviews and purported internal Apple documents, The Information revealed that Tim Cook personally forged a five-year agreement…

Apple Planning Five New Macs for 2022, Including Entry-Level MacBook Pro Refresh

Apple is working on five new Macs for launch in 2022, including a new version of the entry-level MacBook Pro, according to Bloomberg’s Mark Gurman.
In the latest edition of his “Power On” newsletter, Gurman said that he expects Apple to launch five new Macs in 2022, including: A high-end iMac with Apple silicon to sit above the 24-inch iMac in the lineup
A significant MacBook Air…

2022 Apple Watch Lineup Rumored to Include New Apple Watch SE and ‘Rugged’ Model for Sports

Apple is planning an entire revamp of its Apple Watch lineup for 2022, including an update to the Apple Watch SE and a new Apple Watch with a rugged design aimed at sports athletes, according to respected Bloomberg journalist Mark Gurman.
Writing in the latest installment of his Power On newsletter, Gurman said that for 2022, alongside the Apple Watch Series 8, Apple is planning an update to …

iOS 15.2 Adds ‘Parts and Service History’ Feature to iPhone

With the launch of iOS 15.2, Apple is adding a new “Parts and Service History” section to the Settings app that will let users see the service history of their iPhones and confirm that components used for repairs are genuine.
As outlined in a new support document, iPhone users who have iOS 15.2 or later installed can go to Settings > General > About to access Parts and Service History. The…

Apple Music Voice Plan Coming in iOS 15.2

Apple today provided the release candidate version of iOS 15.2 to developers for testing purposes, and in the release notes, Apple says that the new Apple Music Voice Plan is set to launch alongside the update.
Introduced in October, the Voice Plan is a new tier for Apple Music that is priced more affordably than a standard Apple Music plan. It’s $4.99 instead of $9.99, and is designed…

macOS Monterey 12.1 Fixes Major Tap to Click, YouTube HDR, and Charging Bugs

macOS Monterey 12.1, which is set to be released to the public in the near future, addresses several significant bugs that Mac users have been complaining about for weeks.
According to Apple’s release notes, it fixes a bug that could cause the trackpad to become unresponsive to taps or clicks. We reported on the Tap to Click bug earlier this month after receiving dozens of complaints from Mac…

Some SD Cards Not Working Properly With 2021 14 and 16-Inch MacBook Pros

The SD card reader slot on the new 14 and 16-inch MacBook Pro models is not functioning as expected with some SD cards, according to multiple reports on the MacRumors forums.
In a long complaint thread, MacRumors readers have detailed the issues that they’re having with some SD cards, and there seems to be little consistency between reports and affected SD cards. Some SD cards crash and…

Razer Launches MagSafe-Compatible Cooling Fan for iPhones

Razer today announced the launch of the Razer Phone Cooler Chroma, a MagSafe-compatible fan that’s designed to attach to the back of an iPhone.
While there’s a MagSafe version for the iPhone 12 and 13 models, there’s also a second version with a clamp design that’s meant for Android phones and that would also work with non-MagSafe iPhones.
Razer says that the Phone Cooler Chroma has a…

Comments are closed.