3D human-computer interaction

3D human-computer interaction (3D HCI) refers to the methods and technologies that allow users to interact with computers in a three-dimensional space.

It can be summed up as a situation where a person can move something around in 3D, and a computer knows where it is, and the computer can move something around in 3D, and the person knows where it is.

The main area of interest is 3D direct interaction.

It can involve solid view displays.

Control peripherals

• Motion Controllers: Devices like VR controllers that detect movement in three dimensions using IMUs and/or positional tracking, either optical or elsewise.
• Gesture Recognition: Cameras and sensors (e.g., Microsoft Kinect, Leap Motion) that capture body movements and hand gestures.
• Haptic Feedback: Systems that provide tactile feedback to the user, enhancing the sense of touch in a virtual environment.

Visual peripherals

• solid view displays, including biscopic displays and holographic displays
• VR headsets
• Augmented Reality (AR): Overlaying digital information on the real world, typically through gadgets like AR glasses or smartphones.

Interaction techniques

• Manipulation of 3D Objects: Techniques for selecting, rotating, scaling, and otherwise interacting with virtual objects in a three-dimensional space.

History

3D computer interaction succeeds 2D interactions (using a mouse, keyboard, or touch screen).