visionOS 2: Apple Vision Pro Set to Get Major Upgrades and a Critical Security Fix
- A critical security flaw that exposed what Vision Pro users are typing has been patched with visionOS 1.3—here’s what you need to know.
- Additionally, Apple Vision Pro is about to get a major overhaul with visionOS 2, just days away.
- visionOS 2 brings new gestures, spatial photo magic, and more—get stuck into the details now!
Apple's Vision Pro headset is set to receive its major software upgrade, visionOS 2, on Monday, September 16, 2024. Announced at WWDC24 and following nine beta releases, visionOS 2 introduces a host of new features and enhancements. According to recent reports, Apple has already started releasing candidate versions of visionOS 2 to developers.
Photo via UploadVR // Apple Vision Pro’s new visionOS 2 brings a revamped user experience with enhanced hand gestures and customization options.
Summary
- visionOS 2 Launch: New gestures, enhanced hand tracking, and spatial photo capabilities. Read on for more details about visionOS 2.
- Security Fix: Apple has patched the GAZEploit vulnerability in visionOS 1.3, covered in more detail below.
- Enterprise Features: In addition, Apple has added access to Vision Pro’s cameras for business applications.
What’s New in visionOS 2?
- Hand Gestures & Control: visionOS 2 introduces two new hand gestures. Opening your palm and pinching your fingers will bring up the app launcher, while facing your palm down reveals a new hand-locked information bar displaying time, battery life, and connectivity. Pinching this bar will open the Control Center
- Spatial Photo Conversion: The update allows users to transform any 2D image into a 3D Spatial Photo using advanced machine learning technology, adding depth and immersion to visual memories
- Improved Mac Virtual Display: Later this year, visionOS 2 will enable a virtual display equivalent to two 4K monitors side by side, utilizing eye-tracked dynamic foveation for enhanced clarity
- Enhanced Hand Tracking: With a boost to hand tracking accuracy and speed, visionOS 2 provides developers with hand poses at display refresh rates and optional predictive features to lower latency
- Room and Plane Detection: The update improves room tracking and introduces detection for slanted planes, making virtual interactions more seamless and contextually aware
- Safari Enhancements: Safari now supports fullscreen video playback in a virtual environment and WebXR is enabled by default, streamlining access to immersive web content
- AirPlay Integration: The Vision Pro will now function as an AirPlay receiver, allowing content from iPhones, iPads, or Macs to be cast directly to the headset
- New Features for Enterprise: visionOS 2 grants enterprise users access to Vision Pro’s passthrough cameras for custom computer vision applications, though these features are restricted to proprietary in-house apps
Vision Pro Security Flaw Addressed
In a related update, Apple has addressed a significant security vulnerability in the Vision Pro. Discovered earlier this year, the flaw—dubbed GAZEploit—allowed unauthorized access to what users typed, including sensitive information like passwords and messages. Researchers from the University of Florida and other institutions found that by analyzing eye movements, they could reconstruct typed inputs with up to 92% accuracy.
According to WIRED, Apple was alerted to this vulnerability in April and swiftly patched it with the release of visionOS 1.3 in July. The fix involved suspending the Persona avatar during virtual keyboard use to prevent the exposure of typed data.
For detailed information on these updates and features, check the official Apple release notes and developer documentation.
Photo via MarketWatch // The Apple Vision Pro takes center stage during its grand unveiling, showcasing its sleek and unique design.
Recommended by the editors:
Thank you for visiting Apple Scoop! As a dedicated independent news organization, we strive to deliver the latest updates and in-depth journalism on everything Apple. Have insights or thoughts to share? Drop a comment below—our team actively engages with and responds to our community. Return to the home page.Published to Apple Scoop on 13th September, 2024.
No password required
A confirmation request will be delivered to the email address you provide. Once confirmed, your comment will be published. It's as simple as two clicks.
Your email address will not be published publicly. Additionally, we will not send you marketing emails unless you opt-in.