As we've built experiences across HoloLens and immersive headsets, we've started writing down some things we found useful to share. Think of these as the fundamental building blocks for mixed reality interaction design.
Here's an outline of the available Interaction design articles and which device type or types they apply to.
|Perception and spatial features|
|Spatial sound design||✔️||✔️|
|Spatial mapping design||✔️|
Always think about design for your user's point of view as they move about their real and virtual worlds.
Some questions to ask
Users will react to large menus coming at them.
What to avoid
In 2D development, frequently accessed content and settings may be placed in the corners of a screen to make them easily accessible. However, in holographic apps, the corners of the user's field of view may be uncomfortable to access. In this case, the center of the field of view is the prime location for content.
The user may need to be guided to help locate important events or objects outside their field of view. You can use arrows, light trails, character head movement, thought bubbles, pointers, spatial sound, and voice prompts to help guide the user to important content in your app.
It is recommended to not lock content to the screen for the user's comfort. If you need to keep content in view, place it in the world and make the content "tag-along" like the Start Menu. Content that gets pulled along with the user's field of view will feel more natural in the environment.
On HoloLens, holograms feel real when they fit within the field of view since they don't get cut off. Users will move in order to see the bounds of a hologram within their field of view. On HoloLens, it's important to simplify your UI to fit within the user's field of view and keep your focus on the main action. For immersive headsets, it's important to maintain the illusion of a persistent virtual world within the field of view.
To ensure maximum comfort on head-mounted displays, it’s important for designers and developers to create and present content in a way that mimics how humans interpret 3D shapes and the relative position of objects in the natural world. From a physical perspective, it is also important to design content that does not require fatiguing motions of the neck or arms.
Whether developing for HoloLens or immersive headsets, it is important to render visuals for both eyes. Rendering a heads-up display in one eye only can make an interface hard to understand, as well as causing uneasiness to the user's eye and brain.
Using mixed reality capture, users can capture a photo or video of their experience at any time. Consider experiences in your app where you may want to encourage snapshots or videos.
Just like the Windows PC experience starts with the desktop, Windows Mixed Reality starts with the home. The Windows Mixed Reality home leverages our innate ability to understand and navigate 3D places. With HoloLens, your home is your physical space. With immersive headsets, your home is a virtual place.
Your home is also where you’ll use the Start menu to open and place apps and content. You can fill your home with mixed reality content and multitask by using multiple apps at the same time. The things you place in your home stay there, even if you restart your device.