Microsoft HoloLens
Microsoft HoloLens, known under development as Project Baraboo, is a pair of mixed reality smartglasses developed and manufactured by Microsoft. HoloLens was the first head-mounted display running the Windows Mixed Reality platform under the Windows 10 computer operating system. The tracking technology used in HoloLens can trace its lineage to Kinect, an add-on for Microsoft's Xbox game console that was introduced in 2010.
The pre-production version of HoloLens, the Development Edition, shipped on March 30, 2016, and is targeted to developers in the United States and Canada for a list price of $3000. Samsung and Asus have extended an offer to Microsoft to help produce their own mixed-reality products, in collaboration with Microsoft, based around the concept and hardware on HoloLens. On October 12, 2016, Microsoft announced global expansion of HoloLens and publicized that HoloLens would be available for preorder in Australia, Ireland, France, Germany, New Zealand and the United Kingdom. There is also a Commercial Suite, with enterprise features, such as bitlocker security. As of May 2017, The Suite sells for $5,000. Microsoft has decided to rent the Hololens without clients making the full investment. Microsoft partner with a company called Abcomrents to give the service of Hololens rental.
HoloLens 2 was announced at the Mobile World Congress in Barcelona, Spain, on February 24, 2019, and is available on preorder at $3500.
The HoloLens is a head-mounted display unit connected to an adjustable, cushioned inner headband, which can tilt HoloLens up and down, as well as forward and backward. To wear the unit, the user fits the HoloLens on their head, using an adjustment wheel at the back of the headband to secure it around the crown, supporting and distributing the weight of the unit equally for comfort, before tilting the visor towards the front of the eyes.
The front of the unit houses many of the sensors and related hardware, including the processors, cameras and projection lenses. The visor is tinted; enclosed in the visor piece is a pair of transparent combiner lenses, in which the projected images are displayed in the lower half. The HoloLens must be calibrated to the interpupillary distance, or accustomed vision of the user.
Along the bottom edges of the side, located near the user's ears, are a pair of small, red 3D audio speakers. The speakers, competing against typical sound systems, do not obstruct external sounds, allowing the user to hear virtual sounds, along with the environment. Using head-related transfer functions, the HoloLens generates binaural audio, which can simulate spatial effects; meaning the user, virtually, can perceive and locate a sound, as though it is coming from a virtual pinpoint or location.
On the top edge are two pairs of buttons: display brightness buttons above the left ear, and volume buttons above the right ear. Adjacent buttons are shaped differently—one concave, one convex—so that the user can distinguish them by touch.
At the end of the left arm is a power button and row of five, small individual LED nodes, used to indicate system status, as well as for power management, indicating battery level and setting power/standby mode. A USB 2.0 micro-B receptacle is located along the bottom edge. A 3.5 mm audio jack is located along the bottom edge of the right arm.
Hardware
The HoloLens features an inertial measurement unit four "environment understanding" sensors, an energy-efficient depth camera with a 120°×120° angle of view, a 2.4-megapixel photographic video camera, a four-microphone array, and an ambient light sensor.In addition to an Intel Cherry Trail SoC containing the CPU and GPU, HoloLens features a custom-made Microsoft Holographic Processing Unit, a coprocessor manufactured specifically for the HoloLens by Microsoft. The SoC and the HPU each have 1GB LPDDR3 and share 8MB SRAM, with the SoC also controlling 64GB eMMC and running the Windows 10 operating system. The HPU uses 28 custom DSPs from Tensilica to process and integrate data from the sensors, as well as handling tasks such as spatial mapping, gesture recognition, and voice and speech recognition. According to Alex Kipman, the HPU processes "terabytes of information," one attendee estimated that the display field of view of the demonstration units was 30°×17.5°. In an interview at the 2015 Electronic Entertainment Expo in June, Microsoft Vice-President of Next-Gen Experiences, Kudo Tsunoda, indicated that the field of view is unlikely to be significantly different on release of the current version.
The HoloLens contains an internal rechargeable battery, with average life rated at 2–3 hours of active use, or 2 weeks of standby time. The HoloLens can be operated while charging.
HoloLens features IEEE 802.11ac Wi-Fi and Bluetooth 4.1 Low Energy wireless connectivity. The headset uses Bluetooth LE to pair with the included Clicker, a thumb-sized finger-operating input device that can be used for interface scrolling and selecting. The Clicker features a clickable surface for selecting, and an orientation sensor which provides for scrolling functions via tilting and panning of the unit. The Clicker features an elastic finger loop for holding the device, and a USB 2.0 micro-B receptacle for charging its internal battery.
Applications
As of 2016, a number of augmented-reality applications have been announced or showcased for Microsoft HoloLens. A collection of applications will be provided for free for developers purchasing the Microsoft HoloLens Developer Edition. Applications available at launch include:- Cortana, Microsoft's virtual assistant.
- Holograms, a catalog of a variety of 3D objects that users can place and scale around them; ranging from tigers and cats to space shuttles and planets.
- HoloStudio, a full-scale 3D modeling application by Microsoft with 3D print compatibility.
- CAE VimedixAR is a commercial application of Microsoft HoloLens technology that enables immersive simulation-based training in ultrasound and anatomical education through augmented reality for increased patient safety and enhanced learning.
- An implementation of the Skype telecommunications application by Microsoft. Any user with Skype on his or her regular devices like PC, Mobile etc. can dial user on HoloLens and communicate with each other. With Video call On, the user on PC will see the view HoloLens user is seeing and HoloLens user will see view captured by PC / Mobile device user camera.
- HoloTour, an audiovisual three-dimensional virtual tourism application developer by Microsoft and Asobo Studio.
- Fragments, a high-tech crime thriller adventure game developed by Microsoft and Asobo Studio, in which the player engages in crime-solving.
- Young Conker, a platform game developed by Microsoft and Asobo Studio, featuring a young version of Conker the Squirrel.
- RoboRaid, an augmented-reality first-person shooter game by Microsoft in which the player defends against a robot invasion, aiming the weapon via gaze, and shooting via the Clicker button or an air tap.
- Actiongram, an application for staging and recording short video clips of simple mixed-reality presentations using pre-made 3D virtual assets, will be released in summer 2016 in the United States and Canada.
- In November, 2018, Microsoft announced that it is readying HoloLens for combat. The company won a $480 million military contract with the U.S. government to bring AR headset tech into the weapons repertoire of American soldiers.
- An interactive digital human anatomy curriculum by Case Western Reserve University and Cleveland Clinic
- Architectural engineering software design tools, SketchUp Viewer by Trimble Navigation was the first commercially available HoloLens application
- A version of the Mojang video game Minecraft
- Extended functionality for the Autodesk Maya 3D creation application
- OnSight and Sidekick, software projects developed by a collaboration between NASA and Microsoft to explore mixed reality applications in space exploration
- FreeForm, a joint project between Autodesk and Microsoft integrating HoloLens with the Autodesk Fusion 360 cloud-based 3D development application
- Galaxy Explorer, an educational application about the Milky Way in development by Microsoft Studios, pitched and chosen by the developer community via the Share Your Idea campaign, and to be open-sourced upon completion
- A spacecraft design/visualization application in development by NASA's Jet Propulsion Laboratory
- In November 2015, Volvo and Microsoft have exhibited a prototype version of the HoloLens system at Microsoft's HQ in Redmond using the S90 luxury sedan as their subject.
- CAE VimedixAR, the first ultrasound training simulator integrated with HoloLens that allows healthcare learners to interact with 3D holograms of internal human structures and acquire proficiency in anatomy.
- Holoportation, a new type of 3D capture technology that allows high-quality 3D models of people to be reconstructed, compressed and transmitted anywhere in the world in real time. When combined with mixed reality displays such as Hololens, this technology allows user to see, hear, and interact with remote participants in 3D as if they are actually present in the same physical space. Communicating and interacting with remote users becomes as natural as face-to-face communication.
- HoloSurg, in April 2017, a team of surgeons in Spain, used the mixed reality tool to operate on a patient with a malignant muscular tumor, using the headset to visualize MRI and radiography information during the surgery.
- Microsoft Dynamics 365 Remote Assist; can be combined with Microsoft Teams to send a secure live video feed to a computer screen in a nearby room
Interface
The HoloLens shell carries over and adapts many elements from the Windows desktop environment. A "bloom" gesture for accessing the shell is performed by opening one's hand, fingers spread with the palm facing up. Windows can be dragged to a particular position, as well as resized. Virtual elements such as windows or menus can be "pinned" to locations, physical structures or objects within the environment; or can be "carried," or fixed in relation to the user, following the user as they move around. Title bars for application windows have a title on the left, and buttons for window management functions on the right.
In April 2016 Microsoft Created the App for Windows 10 PC's and Windows 10 Mobile devices, that allows developers to run apps, use his or her phone or PC's keyboard to type text, view a live stream from the HoloLens user's point of view, and remotely capture mixed reality photos and videos.