Overview
- Snapchat: fully supported
- SPECS: partially supported
- Camera Kit Web: fully supported
- Camera Kit Mobile: fully supported
- SnapchatFully supported
- SPECSPartially supported
- The 2D Object Tracking component doesn't run; use Object Tracking 3D
- See Interaction Kit Hand Tracking
- Camera Kit WebFully supported
- Camera Kit MobileFully supported
You can track hands in Lenses in 2D screen space, in 3D, and through gestures and interactions.
Tracking Hands
You can detect hands and their parts in different ways.
2D Hand Tracking
Using `Object Tracking 2D` component, you can track the hands and their joints, in 2D space for more efficient tracking.
Read guide
3D Hand Tracking
Using `Object Tracking 3D` component, you can track one or more hands and their joints in 3D space.
Read guide
Hand Mesh
Add a 3D mesh that mimics the user's hand in real time for rendering, mesh effects, and attaching objects.
Read guide
Hand Tracking
Read hand keypoints, react to pinches, and get each hand's interactor position and direction with Interaction Kit.
Read guide
3D Hand Tracking
Track hands and their joints in 3D with the `Object Tracking 3D` component and a Hand Tracking Asset.
Read guide
Hand Visualization
Draw a hand mesh that occludes AR content, or attach your own effects to hand keypoints.
Read guide
When building for SPECS, Interaction Kit tracks hands for you. To read hand joints yourself, use Object Tracking 3D with a Hand Tracking Asset whose Tracking Mode is Hand Tracking (Spectacles).
Detecting Hand Gestures and Interactions
Using the hand tracking capabilities, you can track more complex hand interactions like custom gestures.
Attaching Objects to the Hand in 3D
Learn about the lifecycle of script events and how to bind to them.
Read guide
Detecting Gestures Using Hand Joints in 2D
Learn about the lifecycle of script events and how to bind to them.
Read guide
Detecting Gestures Using Hand Joints in 3D
Learn about the lifecycle of script events and how to bind to them.
Read guide
Detecting Built in Gestures Using ML
Learn how to use modules and reference other scripts and assets.
Read guide
Gesture Module
Detect pinch, palm tap, targeting, grab, and phone-in-hand gestures.
Read guide
Interaction Kit
Set up Interaction Kit 4.0.0 and test hand interactions in the Preview panel.
Read guide
When building for SPECS, detect pinch, grab, and other hand gestures with the Gesture Module. The ML-based Hand Gestures don't run on SPECS.
See More Examples
See the Examples section in the sidebar to learn about other usage, detection, and tracking of hands.