Apple describes interaction with visionOS in their recently published Human Interface Guidelines:
When people wear Apple Vision Pro, they enter an infinite 3D space where they can engage with your app or game while staying connected to their surroundings.
The Vision Pro is a uniquely different kind of general computing device that operates in 3D space. Often referred to as spatial computing. Apple lists 7 fundamental interface guidelines to be aware of:
- Space: The Vision Pro offers a limitless canvas for virtual content and immersive experiences.
- Immersion: Users seamlessly transition between different levels of immersion in either Shared Space or Full Space modes.
- Passthrough: Live video from external cameras allows users to interact with virtual content while seeing their surroundings. Using the Digital Crown users can dial in and out of passthrough
- Spatial Audio: Sonic characteristics of the surroundings are modeled for natural audio experiences.
- Focus and gestures: Users interact with Vision Pro using their eyes and hands. Using their eyes to bring focus and tapping is called an indirect gesture. Interacting with virtual objects with touch is called a direct gesture.
- Ergonomics: Content is automatically adjusted or scaled relative to the wearer’s head for visual comfort.
- Accessibility: Vision Pro supports various accessibility technologies for customized interactions such as VoiceOver, GuidedAccess and more.
P.S. Apple also published their Design Library and Templates for visionOS in Figma here. Enjoy!