Overview

An overview of the asset's provided packages and key features.

The Hand Tracking Unity plugin is an asset designed to track hands and finger joints accurately. Using color data, it detects hands in images, identifies key joint positions, and supports both 2D and 3D joint positioning.

Available packages

There are various options to choose from, depending on the platform you are developing for.

Every package comes with support for the Unity Editor, simplifying your development and testing processes.

All packages support Unity Editor on Mac and Windows.

Package	Runtime	Download
iOS	iOS, iPadOS	Download for iOS
Android	Android	Download for Android
iOS + Android	iOS, iPadOS, Android	Download for iOS + Android
macOS	macOS	Download for macOS
Windows	Windows	Download for Windows
visionOS	Apple Vision Pro	Coming soon

All packages, except visionOS, are compatible with Unity 2020 and later versions. However, packages including visionOS are compatible with Unity 2022 or later due to the lack of support in earlier Unity versions.

Key Features

• Precise Tracking: Detects both 2D and 3D coordinates of each finger joint, ensuring accurate joint positioning in both the image plane and three-dimensional space.

• Out-of-the-Box Visualization: Provides ready-to-use visualization components and comprehensive examples, significantly reducing your development effort.

• Application Versatility: Supports all major platforms, enabling you to develop your application once and deploy it universally.

Workflow

The Hand Tracking Unity plugin is the easiest way to add hand and finger tracking to your application.

You can detect hands and fingers in 3 easy steps:

1. Load a raw RGB-encoded byte array to a Texture2D. The byte array could be an image file, a video file (eg mp4 file) or a camera live feed.

2. Pass the Texture2D to a HandTracker. The HandTracker will detect the hands and fingers in the texture.

3. Access the detected hand's information. The detected Hand includes the following information:

   • Side: The side of the hand (Left or Right).

   • Confidence: The tracking confidence of the hand (0 to 1).

   • Thumb: The 2D and 3D positions for the CMC, MCP, IP and Tip thumb joints.

   • Index: The 2D and 3D positions for the MCP, PIP, DIP and Tip index joints.

   • Middle: The 2D and 3D positions for the MCP, PIP, DIP and Tip middle joints.

   • Ring: The 2D and 3D positions for the MCP, PIP, DIP and Tip ring joints.

   • Pinky: The 2D and 3D positions for the MCP, PIP, DIP and Tip pinky joints.

   • Palm: The 2D and 3D positions for the wrist, middle of the palm, thumb CMC, thumb MCP, index MCP, middle MCP, ring MCP and pinky MCP joints.