Overview
An overview of the asset's provided packages and key features.
The Hand Tracking Unity plugin is an asset designed to track hands and finger joints accurately. Using color data, it detects hands in images, identifies key joint positions, and supports both 2D and 3D joint positioning.
Available packages
There are various options to choose from, depending on the platform you are developing for.
Every package comes with support for the Unity Editor, simplifying your development and testing processes.
All packages support Unity Editor on Mac and Windows.
Package | Runtime | Download |
---|---|---|
iOS | iOS, iPadOS | |
Android | Android | |
iOS + Android | iOS, iPadOS, Android | |
macOS | macOS | |
Windows | Windows | |
visionOS | Apple Vision Pro | Coming soon |
All packages, except visionOS, are compatible with Unity 2020 and later versions. However, packages including visionOS are compatible with Unity 2022 or later due to the lack of support in earlier Unity versions.
Key Features
Precise Tracking: Detects both 2D and 3D coordinates of each finger joint, ensuring accurate joint positioning in both the image plane and three-dimensional space.
Out-of-the-Box Visualization: Provides ready-to-use visualization components and comprehensive examples, significantly reducing your development effort.
Application Versatility: Supports all major platforms, enabling you to develop your application once and deploy it universally.
Workflow
The Hand Tracking Unity plugin is the easiest way to add hand and finger tracking to your application.
You can detect hands and fingers in 3 easy steps:
Load a raw RGB-encoded byte array to a
Texture2D
. The byte array could be an image file, a video file (eg mp4 file) or a camera live feed.Pass the
Texture2D
to aHandTracker
. TheHandTracker
will detect the hands and fingers in the texture.Access the detected hand's information. The detected
Hand
includes the following information:Side: The side of the hand (Left or Right).
Confidence: The tracking confidence of the hand (0 to 1).
Thumb: The 2D and 3D positions for the CMC, MCP, IP and Tip thumb joints.
Index: The 2D and 3D positions for the MCP, PIP, DIP and Tip index joints.
Middle: The 2D and 3D positions for the MCP, PIP, DIP and Tip middle joints.
Ring: The 2D and 3D positions for the MCP, PIP, DIP and Tip ring joints.
Pinky: The 2D and 3D positions for the MCP, PIP, DIP and Tip pinky joints.
Palm: The 2D and 3D positions for the wrist, middle of the palm, thumb CMC, thumb MCP, index MCP, middle MCP, ring MCP and pinky MCP joints.
Last updated