Tutorial: Using Microsoft HoloLens for Perception
September 28th, 2017
IROS 2017 Conference
Microsoft released the HoloLens Developer Edition in March 2016. It is the world’s first untethered augmented-reality device. Developers can create “holographic” applications and share them with the user community through Microsoft’s App Store.
Internally, the HoloLens uses state-of-the-art computer vision algorithms for robust world-tracking, depth calculation and surface reconstruction.
The HoloLens is also a potent research device. Application code can access audio and video streams and surface meshes, all in a world coordinate space maintained by HoloLens’ highly accurate world-tracking.
This half day tutorial at IROS 2017 we will dive into the perception system on the HoloLens and show how to build applications that access the sensor streams. We will also be demonstrating the latest updates to the HoloLens software which offer increasing access to the full power of the device.
The tutorial will cover:
Attendees to this tutorial will leave with a good sense of how the HoloLens can be used for a range of environmental perception research tasks, and materials to quickly get them started using the device.