Apple’s Vision Pro: A revolutionary invention

In a highly anticipated announcement at Apple’s annual software developer conference, Worldwide Developers Conference (WWDC 2023), Tim Cook introduced the tech giant’s long-awaited augmented-reality headset, the Apple Vision Pro.

This launch marks Apple’s significant foray into the world of spatial computing, following the groundbreaking release of the Apple Watch nearly a decade ago.

Interestingly, the company describes it as the most advanced device ever and claims it filed 5,000 patents to make it all happen.

Vision Pro brings 3D objects to life. You can pull a 3D object out of an app and look at it from every angle, as if it’s right in front of you. Bring your Mac wirelessly into Vision Pro with Mac Virtual Display. You can place it anywhere in space and use Vision Pro as an enormous, private, portable 4K display.

Hidden features Vision Pro

Double Chip

The chip, designed specifically for the mixed reality headset, is tasked with running all the sensors embedded into the headset to create precise head and hand tracking, along with real-time 3D mapping and eye-tracking.

With a total of 12 cameras, 5 sensors, 6 microphones, this super-speedy sensor processes data within 12 milliseconds, or one wing-flap of the hummingbird or eight times faster than the blink of an eye.

The combination of an M2 chip to pack a ton of computing power and an R1 chip to deal with inputs –executes the actions with any lag and reduces the possibility of motion sickness, nausea or disorientation. Apart from the R1 chip, the M2 chip, built on the second-generation 5nm architecture, offers an 18 per cent increase in CPU performance compared to the previous M1 processor. The Vision Pro’s operating system software, called VisionOS, runs on the same M2 processor that Apple uses in its Macs.

Face recognition

Vision Pro headset also showcased the innovative face recognition feature, which relies on machine learning (ML). The built-in cameras scan the user’s face, creating it a lifelike product.

During video calls, the digital twin replaces the user, mimicking their expressions and gestures in real time. FaceTime, Teams, Webex and Zoom will support these 3D avatars.

To better show the user’s face when using the headset, it includes an exterior display, on an OLED screen on the exterior that shows the user’s eyes. The EyeSight system allows users to either obscure or reveal their digital eyes to others in the room, indicating their readiness for face-to-face conversation.

Display

The Apple Vision Pro utilises micro-OLED technology to deliver its display capabilities. Apple claims that each eye’s display packs more than a 4K resolution and a total of 23 million pixels.

This translates to a wide field of view (FOV), thereby eliminating the need for integrating extra devices to control virtual environments, where you can just navigate via hand and finger gestures.

In another interesting update, Apple introduced the Mac Virtual Display feature, allowing users to wirelessly bring their Mac content into the Vision Pro headset.

Optic ID

Optic ID, Apple’s third biometric system apart from face and fingerprint recognition, was introduced specifically for the Vision Pro headset. It will be used for unlocking the device and for features like Apple Pay within the headset’s interface.

Privacy

As with all Apple security features, Optic ID is claimed to remain solely on the device and the information is fully encrypted.

Optic ID is just one of the privacy protections implemented in the Vision Pro headset. Eye tracking data will not be accessible by Apple or any other party, and camera and sensor data will be processed at the system level to prevent unauthorised access.

Visual indicators will also be present when capturing photos and videos to respect the privacy of those around the user.

Chief Executive Officer of Apple, Tim Cook has said that consumers can afford Apple’s latest Rs 2.88 lakh-worth Vision Pro AR/VR headset, which will be available next year.

The new headset has been touted as a standalone device, and features dedicated software and processors. Apple boasts Vision Pro’s advanced computing capabilities, which can be viewed as an alternative to the iPhone and MacBook Air. However, a big concern remains the price.