3D human-computer interaction

Users wearing headsets and interacting in 3D

3D human-computer interaction (3D HCI) refers to the methods and technologies that allow users to interact with computers in a three-dimensional space.

3D interaction is human-computer interaction in which the user's tasks are performed directly in a 3D spatial context.

Full-duplex 3D HCI requires a 3D input device and a 3D display. The 3D display can be autostereoscopic, lightfield, or holographic.

It can be summed up as a situation where a person can move something around in 3D, and a computer knows where it is, and the computer can move something around in 3D, and the person knows where it is.

A main area of interest is 3D direct interaction.

It can involve solid view displays.

Control peripherals

• Motion Controllers: Devices like VR controllers that detect movement in three dimensions using IMUs and/or positional tracking, either optical or elsewise.
• Gesture Recognition: Cameras and sensors (e.g., Microsoft Kinect, Leap Motion) that capture body movements and hand gestures.
• Haptic Feedback: Systems that provide tactile feedback to the user, enhancing the sense of touch in a virtual environment.

Visual peripherals

• solid view displays, including biscopic displays and holographic displays
• VR headsets

Interaction techniques

• Manipulation of 3D Objects: Techniques for selecting, rotating, scaling, and otherwise interacting with virtual objects in a three-dimensional space.

History

3D computer interaction succeeds 2D interactions (using a mouse, keyboard, or touch screen).

Uses

This is a list of uses of 3D computer interface that consists of 3D control peripherals and 3D displays.

• Molecular visualization
• Building information modeling (BIM)
• CAD
• Multiphysics simulation
• Military planning and communication
• 3D mathematical visualization software