Skip to main content

Using Hand and Voice Scenarios (500 Series)

Use this guide to help you navigate the OMS Hand and Voice scenarios

J
Written by Jess McGahan
Updated over a week ago

Our 500 Series scenarios (for example, SNR502US) let you interact using both hand gestures and voice commands.

This guide shows you how to interact with patients, colleagues, and equipment using hand gestures, voice commands, and controller functions.


Full Interactive Scenario Guide

Use this interactive scenario walkthrough to help you to navigate the 500 Series Scenarios


  1. Using the Controllers

Understanding how to use your controllers is the first step to successfully navigating the 500 Series scenarios.

To help you get comfortable with the controls, we’ve provided two resources:

Visual Controller Map – shows you where each button is located on the headset controllers.

Button Guide Table – explains what each button does in the scenarios.

We recommend starting with the map to get a sense of where each control sits in your hands, then using the table as a quick reference when you need to remember what a button does. Together, these resources give you both the big picture and the details you need to interact smoothly in the virtual environment.

Visual Controller Map

Button Guide Table

Button

Location

Use

A button

Right controller

Hold to speak to patient or colleague

Back trigger

Right and Left controller

Press to select items in scenario

Side grip button

Right and Left controller

Hold to pick up items in scenario

Thumb-stick

Right controller

Push forward/back to move through the scenario

Thumb-stick

Left controller

Push left/right to turn in the scenario

Menu button

Left controller

Press to open scenario settings

Meta button

Right controller

Press to pause the OMS app and access headset/system settings


2. Speaking in Scenarios

In 500 Series scenarios, you can communicate directly with patients and colleagues using your own voice. This makes interactions feel more natural and realistic.

Use the Speech Guide Table below to see how to speak with each character in the virtual environment.

Speech Guide Table

Character

Action

Speech Guidance

Patient

Hold "A" button on right controller

Speak as you would normally

Colleague / Assistant

Hold "A" button on right controller

Say "Natalie" before addressing colleague


3. Core Interaction Modes

In the 500 series scenarios, you’ll see different visual cues that show you how you can interact with people and objects around you. These cues are called action indicators.

Each indicator has its own look and function — for example, a glowing outline may highlight equipment you can use, while an orb may mark where you can interact in the environment.

This section explains what each action indicator means and how to respond to it.

To help you learn them quickly, we’ve provided two resources:

  • Visual Cue Image – shows what each action indicator looks like in the scenario.

  • Action Indicator Table – explains what each cue means and how to respond.

Use the image to recognize the indicator in VR, then check the table to learn the action you need to take. Together, these resources give you both the visual reference and the step-by-step instructions for smooth interactions.

Visual Cue Image

Action Indicator Table

Action Indicator

What It Means

How to Interact

Outline

Items highlighted with a blue outline can be picked up in scenario

Use the grip function to pick item up

Ghost Shader

A blue ghost shape shows where to place procedural equipment on the patient or environment

After picking up the item, move it into the ghost shape until it locks into place

Orb

Orbs mark where to place examination equipment on the patient

After picking up the item, place it onto the orb to interact

Wrist Menu

A menu located on your left wrist enables some examination options (palpation etc)

Turn your left hand to show the Wrist Menu location. Use touch to select the menu and following options.


4. Moving Around the Environment

In 500 Series scenarios, you can move around the virtual environment in two main ways:

  • Thumb-stick Movement – Push the right thumb-stick to move forward, backward, or and push the the left thumb-stickside to side to move left, right.

  • Teleportation – Point and select a location, then release to jump instantly to that spot.

To help you practice movement, we’ve included two resources:

  • Visual Guide – shows what each movement method looks like in the scenario

  • Guide Table – explains step by step how to use each method

Moving in Scenario Visual Guide

Moving in Scenario Guide Table

Movement Type

When it is Used

How to Move

Teleport

Jump quickly to distant locations or equipment in the room

Point at the floor where you want to go. A blue circle appears - press into the circle to confirm and teleport.

Move Forward / Back

Move closer to or further from objects or people

Push the right thumb-stick forward or backward

Move Left / Right

Move left or right to adjust your position

Push the left thumb-stick left or right

Did this answer your question?