Medical guidance
After many years of teaching and researching Mixed Reality at Stanford University, Dr. Christoph Leuze founded Nakamir with an SBIR grant by the Defense Health Agency to create training and guidance applications for medics. During long development sessions and adjustments of different custom training scenarios, the Nakamir team came up with a unique way that made creation of instructions easier than ever before by utilizing the abundant sensor data that AR headsets like the Microsoft Hololens 2 provide.
Checklist
Medical training relies strongly on well-structured checklists. Our checklist-based system guides the user through different well-defined procedures based on user input. A presentation of the application can be seen here.
Anatomy
Accessing the AR headset camera sensor data allows to process and understand the environment in front of the user. Together with the DHA, we have applied a neural network for patient body tracking.
NARA
By fusing the sensor data we have created NARA, the Nakamir Augmented Reality Assistant. NARA is the first AR application that makes creation of a virtual training avatar as easy as taking a video. The sensor-based approach allows simple integration of image processing and neural networks to make NARA more intelligent over time.
Content creation
The unique simplicity of NARA allows providers for the first time to create AR training content themselves. Content curation doesn't require the help of a dedicated developer team and allows NARA to be used in a wide variety of scenarios.