Body
Body tracking, body textures and meshes, and object tracking.
Commonly used
ObjectTracking3DUsed to track objects in 3D space, such as body, hands.ObjectTrackingUsed to track objects in 2D space, such as body parts, pet, hand.
Guides
3D Body and Face TrackingThe 3D Body Tracking and Body Mesh features in Lens Studio let you apply effects to a user's body, while the Head and Face Mesh features track facial elements (like expressions,…Hand TrackingUse Interaction Kit hand tracking on SPECS to read hand keypoints, react to pinches, and get the position and direction of each hand's interactor.ArchitectureHow Interaction Kit for SPECS is structured: input data providers, interactors, Interactables, and the InteractionManager that processes their events each frame.
All APIs in this topic
Add components to a scene object and reference assets and other modules with a script input.
Components, assets, and modules
| API | Description |
|---|---|
| BodyTrackingAsset | Configures 3D Body Tracking for the ObjectTracking3D component. |
| Object3DAsset | Base class for configuring object tracking in the ObjectTracking3D component. |
| ObjectTracking | Used to track objects in 2D space, such as body parts, pet, hand. |
| ObjectTracking3D | Used to track objects in 3D space, such as body, hands. |
| PersonTrackingScope | The person that a tracker should use. |
| UpperBodyTrackingAsset | Configures 3D Upper Body Tracking for the ObjectTracking3D component. |
Objects and data
| API | Description |
|---|---|
| BodyDepthTextureProvider | Provides depth values of the tracked body encoded as D24_UNORM_S8_UINT in screen resolution. |
| BodyInstanceSegmentationTextureProvider | Provides segmentation confidence values encoded in the R channel. |
| BodyNormalsTextureProvider | Provides surface normal values of the tracked body encoded as RGBA (x, y, z, confidence) in R8G8B8A8_UNORM format in screen resolution. |
| BodyRenderObjectProvider | Provider for full Body Mesh render object. |
| CustomObject3DAsset | |
| CustomObject3DSpecificData | |
| ObjectSpecificData | Provides additional data for the tracked object. |
| ObjectTrackingMaskedTextureProvider | |
| ObjectTrackingNormalsTextureProvider | |
| ObjectTrackingTextureProvider | Controls a segmentation texture and its placement using information provided by Object tracking. |
| UpperBodyRenderObjectProvider | Provides a render object of the upper body, without the head. |