Difference between revisions of "HoloLens"

From XVRWiki
Jump to navigation Jump to search
 
(12 intermediate revisions by the same user not shown)
Line 14: Line 14:
 
|}}
 
|}}
 
The '''Hololens''' is an [[augmented reality headset]] from [[Microsoft]]. It has a transparent display and 3D tracking. It is called "HoloLens" because it enables users to see what Microsoft calls "holograms". It features a pair of optical see through near-eye displays.
 
The '''Hololens''' is an [[augmented reality headset]] from [[Microsoft]]. It has a transparent display and 3D tracking. It is called "HoloLens" because it enables users to see what Microsoft calls "holograms". It features a pair of optical see through near-eye displays.
 +
 +
The eye-piece components of HoloLens are transparent. It is able to display 3D virtual objects as if they were in the real world through its see-through displays.<ref name=”one”>Microsoft. Microsoft HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens</ref><ref name=”two”>Microsoft. Why HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens/why-hololens</ref>
  
 
The HoloLens was developed at about the same time as the [[Magic Leap 1]].
 
The HoloLens was developed at about the same time as the [[Magic Leap 1]].
 
The eye-piece components of HoloLens are transparent. It is able to project high-definition (HD) virtual content over real world objects using its see-through displays.<ref name=”one”>Microsoft. Microsoft HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens</ref><ref name=”two”>Microsoft. Why HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens/why-hololens</ref>
 
  
 
It requires a Microsoft account to set up.
 
It requires a Microsoft account to set up.
Line 23: Line 23:
 
Microsoft HoloLens has a Windows 10 computer built in. It has sensors, including cameras for [[camera-based tracking]].
 
Microsoft HoloLens has a Windows 10 computer built in. It has sensors, including cameras for [[camera-based tracking]].
 
__NOTOC__
 
__NOTOC__
==Specifications==
+
==Operation==
===Displays===
+
[[File:Hololens augmented reality.jpeg|thumb|HoloLens in use]]
 +
HoloLens uses cameras to track the environment and establish a frame of reference.
 +
 
 +
==Displays==
 
The [[field of view]] (FOV) is small: 30 degrees horizontal and 17.5 degrees vertical.
 
The [[field of view]] (FOV) is small: 30 degrees horizontal and 17.5 degrees vertical.
  
Line 31: Line 34:
 
It is optically comparable with the [[Hololens 2]] and the [[Magic Leap 1]].
 
It is optically comparable with the [[Hololens 2]] and the [[Magic Leap 1]].
  
===Sensors===
+
==3D tracking==
Sensors include head tracking [[IMU]]s (Inertial Measuring Unit); a sound capture system consisting of an array of 4 microphones; an energy efficient depth camera with 120°×120° [[FOV]], an RGB 2-megapixel photo / HD video camera and an ambient light sensor. Additionally, it has 4 greyscale environment sensing cameras that work with the depth camera to track the head, hands and the surrounding environment.
+
Sensors include head tracking [[IMU]]s (Inertial Measuring Unit), a depth camera with 120°×120° [[FOV]], an RGB 2-megapixel photo / HD video camera and an ambient light sensor. Additionally, it has 4 greyscale environment sensing cameras that work with the depth camera to track the head, hands and the surrounding environment.
  
===Processors===
+
==Processors==
 
For processors, in addition to [[CPU]] and [[GPU]], HoloLens has an [[HPU]], ([[holographic processing unit]]). The HPU consolidates and processes all the data from various sensors and produces a stream of useful information to the other processors. HPU removes the burden from the CPU and GPU of handling heavy external data.
 
For processors, in addition to [[CPU]] and [[GPU]], HoloLens has an [[HPU]], ([[holographic processing unit]]). The HPU consolidates and processes all the data from various sensors and produces a stream of useful information to the other processors. HPU removes the burden from the CPU and GPU of handling heavy external data.
  
 
[[HPU]] - processes all of the data from its sensors, depth camera, microphone etc.
 
[[HPU]] - processes all of the data from its sensors, depth camera, microphone etc.
  
===Input and Interface===
+
==Power and Connectivity==
A microUSB port is present for charging and connection. It is possible to use Microsoft HoloLens while it’s charging over microUSB.<ref name=”four”></ref>
 
 
 
===Power and Connectivity===
 
 
The battery in HoloLens lasts around 2.5 hours during intensive use. It lasts around 5.5 hours during less intensive use.  
 
The battery in HoloLens lasts around 2.5 hours during intensive use. It lasts around 5.5 hours during less intensive use.  
  
Line 48: Line 48:
  
 
HoloLens can run any universal Windows 10 app.
 
HoloLens can run any universal Windows 10 app.
 +
 +
A microUSB port is present for charging and connection. It is possible to use Microsoft HoloLens while it’s charging over microUSB.<ref name=”four”></ref>
  
 
==Announcement and Release==
 
==Announcement and Release==
Line 53: Line 55:
  
 
==Features==
 
==Features==
3D projections that can be anchored onto real life objects. These virtual objects are projected at about 60 cm (near plane) to few meters.
+
[[File:Single-aruco-marker.jpeg|thumb|object displayed through a HoloLens]]
 
+
3D projections that can be anchored in the real world. These virtual objects are projected at about 60 cm (near plane) to few meters.  
[[Spatial Mapping]] - scans the environment in real time to create a mesh of an X/Y/Z coordinate plane. Objects can be accurately projected into the mesh.
 
 
 
[[Spatial Audio]] - in-app audio will come from different directions which depend on where you are in relation to the virtual object making the sound
 
 
 
[[#Voice|Voice Recognition]] - recognizes various voice commands.
 
  
[[#Gesture|Gesture Recognition]] - recognizes various gesture commands such as the [[Air Tap]].
+
[[Spatial Mapping]] - scans the environment in real time to create a mesh of an X/Y/Z coordinate plane. Objects can be projected into the mesh.
  
 
[[#Gaze|Gaze Recognition]] - HoloLens tracks your gaze.
 
[[#Gaze|Gaze Recognition]] - HoloLens tracks your gaze.
 
==Commands==
 
===Gesture===
 
{| class="wikitable sortable"
 
|-
 
!Action
 
!Description
 
!Effect
 
|-
 
|[[Air Tap]] || With your index finger pointed upward, bend it forward || Simulates a mouse click in a desktop environment. Activates the interactive component
 
|-
 
|Home/Start || Opening your hand with palm facing up || Simulates the Windows key on a keyboard or Home button on a Windows Tablet. Opens up the holographic start menu.
 
|-
 
|}
 
  
 
==Input gadgets==
 
==Input gadgets==
Line 84: Line 67:
 
'''Bluetooth Mouse and Keyboard'''
 
'''Bluetooth Mouse and Keyboard'''
  
==User interface==  
+
==Software==  
HoloLens can project various Windows 10 applications onto walls and other objects. Users can interact with these projections with gaze, gestures and voice commands.
+
The HoloLens user interface consists of a bunch of floating windows, and some 3D objects.
  
 
[[List of HoloLens 1 applications]]
 
[[List of HoloLens 1 applications]]
  
==Developer==
+
===Development===
 
Hololens uses [[Windows Mixed Reality]], based on Windows 10.
 
Hololens uses [[Windows Mixed Reality]], based on Windows 10.
  
 
To develop for HoloLens, you need a Windows 10 PC able to run [[Visual Studio 2015]] and [[Unity]].
 
To develop for HoloLens, you need a Windows 10 PC able to run [[Visual Studio 2015]] and [[Unity]].
  
====HoloLens emulator====
+
There is a [[HoloLens Emulator]] that allows the user to test Holographic apps on their PCs without the need of a physical HoloLens. It is simulated using a keyboard, mouse, and/or xbox controller. The human and environmental inputs that would usually be read by the sensors on the HoloLens are instead simulated using your keyboard, mouse, or Xbox controller. Apps don't need to be modified to run on the emulator and don't know that they aren't running on a real HoloLens.<ref>Microsoft. Using the HoloLens emulator. Retrieved from https://developer.microsoft.com/en-us/windows/holographic/using_the_hololens_emulator</ref>
[[HoloLens Emulator]] allows the user to test Holographic apps on their PCs without the need of a physical HoloLens.
 
 
 
It is simulated using a keyboard, mouse, and/or xbox controller.
 
 
 
The human and environmental inputs that would usually be read by the sensors on the HoloLens are instead simulated using your keyboard, mouse, or Xbox controller.
 
 
 
Apps don't need to be modified to run on the emulator and don't know that they aren't running on a real HoloLens.<ref>Microsoft. Using the HoloLens emulator. Retrieved from https://developer.microsoft.com/en-us/windows/holographic/using_the_hololens_emulator</ref>
 
  
 
==References==
 
==References==

Latest revision as of 15:54, 14 March 2025

Microsoft HoloLens
Microsoft hololens3.jpg
Developer Microsoft Corporation
Operating system NA
Resolution 1268x720
Field of view NA
Weight grams
Controls

The Hololens is an augmented reality headset from Microsoft. It has a transparent display and 3D tracking. It is called "HoloLens" because it enables users to see what Microsoft calls "holograms". It features a pair of optical see through near-eye displays.

The eye-piece components of HoloLens are transparent. It is able to display 3D virtual objects as if they were in the real world through its see-through displays.[1][2]

The HoloLens was developed at about the same time as the Magic Leap 1.

It requires a Microsoft account to set up.

Microsoft HoloLens has a Windows 10 computer built in. It has sensors, including cameras for camera-based tracking.

Operation[edit]

HoloLens in use

HoloLens uses cameras to track the environment and establish a frame of reference.

Displays[edit]

The field of view (FOV) is small: 30 degrees horizontal and 17.5 degrees vertical.

Its total diagonal FOV is about 30 degrees.[3]

It is optically comparable with the Hololens 2 and the Magic Leap 1.

3D tracking[edit]

Sensors include head tracking IMUs (Inertial Measuring Unit), a depth camera with 120°×120° FOV, an RGB 2-megapixel photo / HD video camera and an ambient light sensor. Additionally, it has 4 greyscale environment sensing cameras that work with the depth camera to track the head, hands and the surrounding environment.

Processors[edit]

For processors, in addition to CPU and GPU, HoloLens has an HPU, (holographic processing unit). The HPU consolidates and processes all the data from various sensors and produces a stream of useful information to the other processors. HPU removes the burden from the CPU and GPU of handling heavy external data.

HPU - processes all of the data from its sensors, depth camera, microphone etc.

Power and Connectivity[edit]

The battery in HoloLens lasts around 2.5 hours during intensive use. It lasts around 5.5 hours during less intensive use.

HoloLens can connect to any WiFi or Bluetooth-equipped device.

HoloLens can run any universal Windows 10 app.

A microUSB port is present for charging and connection. It is possible to use Microsoft HoloLens while it’s charging over microUSB.[4]

Announcement and Release[edit]

Microsoft HoloLens was announced during a Windows 10 Event. The Development Edition was released for $3,000 or £2,000. It allowed developers to start making apps and games for the headset. Months later, it became available to anyone with a Microsoft account.[4][5]

Features[edit]

object displayed through a HoloLens

3D projections that can be anchored in the real world. These virtual objects are projected at about 60 cm (near plane) to few meters.

Spatial Mapping - scans the environment in real time to create a mesh of an X/Y/Z coordinate plane. Objects can be projected into the mesh.

Gaze Recognition - HoloLens tracks your gaze.

Input gadgets[edit]

HoloLens Clicker - a small clicker with a loop that wraps around your middle or index finger. It is held with the microUSB port towards your body and your thumb resting on top of the click, in the indentation. The clicker features a single button and rotational tracking. It allows a user to click and scroll with minimal hand motion as a replacement for the air-tap gesture.

Bluetooth Mouse and Keyboard

Software[edit]

The HoloLens user interface consists of a bunch of floating windows, and some 3D objects.

List of HoloLens 1 applications

Development[edit]

Hololens uses Windows Mixed Reality, based on Windows 10.

To develop for HoloLens, you need a Windows 10 PC able to run Visual Studio 2015 and Unity.

There is a HoloLens Emulator that allows the user to test Holographic apps on their PCs without the need of a physical HoloLens. It is simulated using a keyboard, mouse, and/or xbox controller. The human and environmental inputs that would usually be read by the sensors on the HoloLens are instead simulated using your keyboard, mouse, or Xbox controller. Apps don't need to be modified to run on the emulator and don't know that they aren't running on a real HoloLens.[6]

References[edit]

  1. Microsoft. Microsoft HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens
  2. Microsoft. Why HoloLens. Retrieved from https://www.microsoft.com/en-us/hololens/why-hololens
  3. "How does the Hololens 2 matter?". 2019-02-24. https://stevesspace.com/2019/02/how-does-hololens2-matter/.
  4. Jump up to: 4.0 4.1 Cite error: Invalid <ref> tag; no text was provided for refs named ”four”
  5. Spence, E. (2017). Microsoft HoloLens Review: Winning the reality wars. Retrieved from https://www.forbes.com/sites/ewanspence/2017/01/14/microsoft-hololens-review-experience-review/2/#4053cf3d43f9
  6. Microsoft. Using the HoloLens emulator. Retrieved from https://developer.microsoft.com/en-us/windows/holographic/using_the_hololens_emulator