WWDC24: VisionOS updates

Apple's VisionOS 2.0 is here, and it's packed with a host of new features that are set to redefine our interaction with technology. Designed to seamlessly integrate mixed reality (MR) into our daily lives, VisionOS promises a plethora of exciting functionalities.

WWDC24: VisionOS updates
Photo by Roméo A. / Unsplash

Apple's VisionOS 2.0 is here, and it's packed with a host of new features that are set to redefine our interaction with technology. Designed to seamlessly integrate mixed reality (MR) into our daily lives, VisionOS promises a plethora of exciting functionalities.

Let's take a quick dive into what makes VisionOS 2.0 a game-changer.

Create Spatial Photos

Imagine capturing photos that you can explore in 3D. With VisionOS, users can now create spatial photos, allowing memories to be relived in a dynamic, immersive way. This feature takes regular photography to the next level, making every shot a 360-degree experience.

Volumetric APIs

Volumetric APIs in VisionOS 2.0 provide developers with the tools to create content that has volume and depth. This means more realistic MR experiences, from games to virtual meeting spaces, making interactions more lifelike and engaging.

TabletopKit

With TabletopKit, your tabletop can transform into a gaming arena or a workspace. This innovative feature allows for interactive, spatially-aware applications that adapt to the physical surfaces around you, blending the digital and physical worlds seamlessly. Anchor your chess board to the table, and hit play!

Enterprise APIs

VisionOS isn't just for fun and games; it’s also designed for serious business. The Enterprise APIs enable businesses to develop customised MR solutions, enhancing productivity and collaboration in the workplace. The biggest news about enterprise APIs is that they get access to Vision Pro's cameras, this is a big deal, and willl unlock all kind of new applications otherwise not possible without access.

Keyboard Breakthrough

Typing in MR has never been easier, thanks to the new keyboard breakthrough in VisionOS. This feature offers a more intuitive and responsive typing experience, making it effortless to compose emails, write documents, or chat with friends in an MR environment.

New Bora Bora Environment

Need a virtual getaway? The Bora Bora Environment in VisionOS offers a stunning, immersive escape to a tropical paradise. This feature can be used for relaxation, meditation, or just a quick mental break during a busy day. Or use as a background alone or with SharePlay.

Multiview in TV App

VisionOS enhances your TV viewing experience with Multiview in the TV app. This allows you to watch multiple shows or sports games simultaneously, creating a dynamic and personalised entertainment experience.

NewTravel Mode on Trains

VisionOS ensures that you remain productive even while commuting. Travel Mode on trains optimises your MR experience for a moving environment, making it easier to work, play, or relax on the go. So not just for flights now!

New Apple Immersive Video

Get ready for a new level of video content with Apple Immersive Video. This feature brings videos to life in MR, offering a more engaging and interactive viewing experience that surrounds you.

SharePlay for Photos

Sharing memories with friends and family is now more interactive with SharePlay for Photos. This VisionOS feature allows you to share your spatial photos in real-time, making photo sharing a more social and engaging activity.

Mouse Support

VisionOS also introduces mouse support, bridging the gap between traditional computing and MR. This feature makes it easier for users to navigate and control their MR environments using familiar peripherals.

AirPlay Receiver

The AirPlay Receiver functionality in VisionOS allows you to stream content from your other Apple devices directly to your MR environment, creating a seamless multimedia experience.

Rearrangeable Home View

Customisation is key with VisionOS, and the Rearrangeable Home View lets you organise your MR interface to suit your needs. Whether it’s for work, entertainment, or personal projects, you can set up your MR space exactly how you like it.

HealthKit Integration

HealthKit in VisionOS brings your health and fitness data into your MR world. This feature allows you to visualise your progress, set goals, and track your health metrics in a more interactive and engaging way. Vision Pro isn't the easiest headset to use for fitness, what with the tethered battery puck, but die hards with find a way.

New Hand Gestures

VisionOS introduces new gestures that make interacting with your MR environment more natural and intuitive. These gestures enhance usability and provide a more immersive experience.

Follow Your Breathing

Wellness takes center stage with the Follow Your Breathing feature. This tool helps you practice mindfulness and relaxation techniques by guiding your breathing in an MR environment.

Recent Guest User

The Recent Guest User feature in VisionOS makes it easy to switch between different users. This is particularly useful for shared devices, ensuring that everyone’s preferences and settings are easily accessible.

Mac Virtual Display Enhancements

VisionOS brings significant improvements to the Mac Virtual Display, making it more efficient and versatile. This feature allows you to use your Mac within your MR environment, enhancing productivity and multitasking capabilities.

Xcode 16 Beta Release Notes | Apple Developer Documentation
Update your apps to use new features, and test your apps against API changes.

VisionOS is more than just an operating system; it's a visionary leap into the future of what's possible in mixed reality. With its comprehensive suite of features, VisionOS is set to transform how we interact with technology, making MR an integral part of our daily lives.