AR & Tracking
Tracking bodies, faces, hands and the world, the camera, and location; the tracking types every tracker shares sit directly under it.
Topics in this section
BodyBody tracking, body textures and meshes, and object tracking.FaceFace tracking, face effects, and face expression events.HandHand tracking: 3D hand tracking assets, hand meshes, and hand data. (SPECS hand gestures are under Interaction, with the Gesture Module guide.)WorldDevice tracking, planes, world mesh, hit tests, markers, anchors, and scanning.CameraCamera frames and still images, depth, segmentation, and front/back camera events.Location & NavigationGPS, compass, maps, city-scale and custom locations, and geo-anchored content.
Shared across AR & Tracking
Reference assets and other modules with a script input.
Components, assets, and modules
| API | Description |
|---|---|
| TextureTrackingScope | Provides a Texture to do face tracking on for entities like Head, FaceStretch, and FaceMesh. |
| TrackingScope | The scope, such as the texture it should track against, in which a tracker, such as FaceMaskVisual, EyeColorVisual, BodyDepthTextureProvider, should be applied. |
Objects and data
| API | Description |
|---|---|
| TrackingStatus | TrackingStatus signals changes in data availability for the tracked object. |
Guides
World Mesh and Depth TextureWorld Mesh provides a real-time 3D reconstruction of the real world based on what your device sees.3D Body and Face TrackingThe 3D Body Tracking and Body Mesh features in Lens Studio let you apply effects to a user's body, while the Head and Face Mesh features track facial elements (like expressions,…World Query ModulePlace virtual objects on real-world surfaces on SPECS with depth-based hit-test raycasting and optional surface classification.Depth ModuleRequest depth frames on SPECS to understand scene geometry, measure distances, and place content against real-world surfaces.LocationRead GPS coordinates and compass heading on SPECS with the Location API to build location-aware Lenses.World Tracking PlanesThe World Tracking Planes Example provides multiple Tracked Planes on the surfaces your device detects, allowing developers to understand and utilize the physical environment in…
Related topics
Graphics, Materials & Particles › Textures & VideoTexture assets and providers, video playback and recording, and media pickers.Graphics, Materials & Particles › Meshes & EffectsMesh visuals and mesh building, VFX, post effects, and Gaussian splats.Cloud, Networking & Storage › StorageData kept on the device between sessions, and cloud storage shared across users or locations.