Compatibility
- Snapchat: fully supported
- SPECS: partially supported
- Camera Kit Web: fully supported
- Camera Kit Mobile: fully supported
- SnapchatFully supported
- SPECSPartially supported
- Models run on device only after W8A8 quantization and conversion to Qualcomm DLC, and DLC models don't run in Lens Studio Preview
- Camera Kit WebFully supported
- Camera Kit MobileFully supported
SnapML optimizes the execution of your model by leveraging device-specific hardware acceleration when available. This page provides information on which ML layers are available for acceleration.
✔️ indicates availability. ❌ indicates unavailability.
:::
When building for SPECS, models run on the device's Qualcomm accelerator after W8A8 quantization and conversion to Qualcomm DLC, so this table's columns don't describe SPECS. DLC models don't run in Lens Studio Preview, so test on SPECS.
| Layers | CPU (all devices) | iPhone GPU | iPhone NPU | Android GPU | Comments |
|---|---|---|---|---|---|
| Absolute | ✔️ | ✔️ | ✔️ | ✔️ | |
| Argmax | ✔️ | ✔️ | ❌ | ✔️ | Supports along channel axis |
| Argmin | ✔️ | ✔️ | ❌ | ✔️ | Supports along channel axis |
| Batch Matrix Multiplication | ✔️ | ✔️ | ❌ | ❌ | |
| Batch Normalization | ✔️ | ✔️ | ✔️ | ✔️ | Supports batch normalization fusion |
| Concat | ✔️ | ✔️ | ✔️ | ✔️ | Supports batch and channel axis |
| Constant | ✔️ | ✔️ | ❌ | ✔️ | Supports constant tensors in eltwise operation using Android GPU |
| Convolution | ✔️ | ✔️ | ✔️ | ✔️ | Supports same dilation and stride in height and width, padding can't be larger than kernel size using CPU and GPU, regular convolution (group is 1) and depth convolution using Android GPU |
| Transposed Convolution | ✔️ | ✔️ | ✔️ | ✔️ | Supports dilation is 1, same stride, padding, and kernel size in height and width, regular transposed convolution (group is 1) and depth transposed convolution, padding can't be larger than kernel size |
| Cos | ✔️ | ✔️ | ❌ | ✔️ | |
| Eltwise Add | ✔️ | ✔️ | ✔️ | ✔️ | Supports operation among multiple tensors, and broadcasting along channel or height/width |
| Eltwise Div | ✔️ | ✔️ | ❌ | ✔️ | Supports operation among multiple tensors, the first one has the largest size, and broadcasting along channel or height/width |
| Eltwise Max | ✔️ | ✔️ | ✔️ | ✔️ | Supports operation among multiple tensors, all tensors must have same dimension |
| Eltwise Min | ✔️ | ✔️ | ✔️ | ✔️ | Supports operation among multiple tensors, all tensors must have same dimension |
| Eltwise Mul | ✔️ | ✔️ | ✔️ | ✔️ | Supports operation among multiple tensors, and broadcasting along channel or height/width |
| Eltwise Sub | ✔️ | ✔️ | ❌ | ✔️ | Supports operation among multiple tensors, the first one has the largest size, and broadcasting along channel or height/width |
| ELU | ✔️ | ✔️ | ✔️ | ✔️ | |
| Embedding | ✔️ | ✔️ | ❌ | ✔️ | |
| Exponential | ✔️ | ✔️ | ❌ | ✔️ | |
| Flatten | ✔️ | ✔️ | ❌ | ✔️ | |
| Fully Connected | ✔️ | ✔️ | ✔️ | ✔️ | |
| Instance Normalization | ✔️ | ✔️ | ❌ | ✔️ | |
| Inverse | ✔️ | ✔️ | ❌ | ✔️ | |
| Leaky ReLU | ✔️ | ✔️ | ✔️ | ✔️ | |
| Linear | ✔️ | ✔️ | ✔️ | ✔️ | |
| Log | ✔️ | ✔️ | ✔️ | ✔️ | |
| LSTM | ✔️ | ✔️ | ❌ | ❌ | |
| Padding | ✔️ | ✔️ | ✔️ | ✔️ | Supports CONSTANT, REFLECT and SYMMETRIC padding types |
| Permute | ✔️ | ✔️ | ❌ | ✔️ | |
| Pooling Average | ✔️ | ✔️ | ✔️ | ✔️ | Padding can't be larger than kernel size |
| Pooling Global Average | ✔️ | ✔️ | ✔️ | ✔️ | |
| Pooling Max | ✔️ | ✔️ | ✔️ | ✔️ | Padding can't be larger than kernel size |
| Power | ✔️ | ✔️ | ✔️ | ✔️ | |
| Parametric ReLU | ✔️ | ✔️ | ✔️ | ✔️ | |
| Reduce Mean | ✔️ | ✔️ | ❌ | ✔️ | Supports reduction axis along N, C, HW, and HWC using CPU and iPhone GPU, and reduction axis along N, C, and HW using Android GPU |
| Reduce Max | ✔️ | ✔️ | ❌ | ✔️ | Supports reduction axis along N, C, HW, and HWC using CPU and iPhone GPU, and reduction axis along N, C, and HW using Android GPU |
| ReLU | ✔️ | ✔️ | ✔️ | ✔️ | |
| ReLU6 | ✔️ | ✔️ | ✔️ | ✔️ | |
| Reshape | ✔️ | ✔️ | ❌ | ✔️ | |
| Resize Bilinear | ✔️ | ✔️ | ✔️ | ✔️ | Supports same scaling factors in height and width, recommends to set align_corners as true in training since the implementation is consistent between TensorFlow and PyTorch |
| Resize Nearest Neighbor | ✔️ | ✔️ | ✔️ | ✔️ | Supports same scaling factors in height and width |
| RNN | ✔️ | ✔️ | ❌ | ❌ | |
| Sigmoid | ✔️ | ✔️ | ✔️ | ✔️ | |
| Sin | ✔️ | ✔️ | ❌ | ✔️ | |
| Slice | ✔️ | ✔️ | ❌ | ✔️ | |
| Softmax | ✔️ | ✔️ | ✔️ | ✔️ | Supports along channel axis |
| Softplus | ✔️ | ✔️ | ❌ | ✔️ | |
| Softsign | ✔️ | ✔️ | ❌ | ✔️ | |
| Square Root | ✔️ | ✔️ | ❌ | ✔️ | |
| Tanh | ✔️ | ✔️ | ✔️ | ✔️ |