%2C%203.13-yellow){kind=icon}
The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for deployment on Qualcomm® devices.
See supported: On-Device Runtimes, Hardware Targets & Precision, Chipsets, Devices
Choose the package that fits your use case (both provide the qai-hub-models command-line interface):
# Lightweight CLI for:
# - browsing the catalog (model info, performance, & evals)
# - downloading deployable model assets
pip install qai-hub-models-clior
# The full package, for exporting from source, evaluating models, and running end-to-end demos. Includes the CLI.
#
# NOTE for Snapdragon X Elite and Snapdragon X2 Elite users:
# AMDx64 (64-bit) Python is required on Windows.
# Installation will fail when using Windows ARM64 Python.
pip install qai_hub_models
Use the CLI to browse the catalog and download deployable assets:
qai-hub-models models # browse the catalog
qai-hub-models info mobilenet_v2 # model details + download options
qai-hub-models numerics mobilenet_v2 # model evaluation results
qai-hub-models perf mobilenet_v2 # model performance results
qai-hub-models fetch mobilenet_v2 --runtime tflite --precision float # download a deployable asset
# ... and moreThe CLI also offers a Python API. See the CLI README for full usage instructions.
All models in our directory can be compiled and profiled on a hosted Qualcomm® device.
The downloads and numerics / performance results published with each release are generated by the export and evaluate commands outlined below.
Create a Qualcomm® ID, use it to login to Qualcomm® AI Hub Workbench, and configure your API token:
qai-hub configure --api_token API_TOKENqai-hub-models install yolov7# Quantize the floating point model to w8a8, convert it to LiteRT format, and profile it on the Samsung Galaxy S25.
qai-hub-models export yolov7 --target-runtime tflite --precision w8a8 --device "Samsung Galaxy S25 (Family)"
# Download a dataset and run evaluation of the LiteRT model on the Samsung Galaxy S25.
qai-hub-models evaluate yolov7 --hub-model-id <Model ID printed by export>Export and evaluate use Qualcomm® AI Hub Workbench to:
- If applicable, Quantize the model (see: Quantization on AI Hub Workbench)
- Compile the model for the chosen device and target runtime (see: Compiling Models on AI Hub Workbench).
- Download the model.
- Profile the compiled model on a real device in the cloud (see: Profiling Models on AI Hub Workbench).
- Evaluate the model on a subset of a dataset on a real device in the cloud, and compare on-device model output with PyTorch output (see: Running Inference on AI Hub Workbench)
Native applications that can run our models (with pre and post processing) on physical devices are published in the AI Hub Apps repository.
Python applications are defined for all models (from qai_hub_models.models.<model_name> import App). These apps wrap model inference with pre- and post-processing steps written using torch & numpy. These apps are optimized to be an easy-to-follow example, rather than to minimize prediction time.
Most models have demos that run the model end-to-end (including pre/postprocessing).
qai-hub-models install yolov7# Use PyTorch to predict and draw bounding boxes on the provided image.
#
# This runs the model using standard PyTorch kernels via your local CPU or GPU (no NPU support).
qai-hub-models demo yolov7 [--image <path>] [--help]# Upload the image and compiled model to a cloud-hosted device,
# run the model, download results, and draw bounding boxes.
#
# This uses a hardware-accelerated target runtime (eg. Lite RT), rather than PyTorch, to run the model.
# Pre and postprocessing may still require numpy and/or PyTorch.
# However, we strive to include as much pre/postprocessing in the accelerated model as is feasible.
#
# NOTE: Not all models have a cloud-hosted demo; some are PyTorch only.
qai-hub-models demo yolov7 [--image ...] --eval-mode on-device --hub-model-id <Model ID printed by export>End-to-end demos:
- Preprocess human-readable input into model input
- Run model inference either locally via PyTorch-CPU, or on a cloud-hosted Qualcomm® device.
- Postprocess model output to a human-readable format
| Runtime | Supported OS |
|---|---|
| Qualcomm AI Engine Direct | Android, Linux, Windows |
| LiteRT (TensorFlow Lite) | Android, Linux |
| ONNX | Android, Linux, Windows |
| Device Compute Unit | Supported Precision |
|---|---|
| CPU | FP32, INT16, INT8 |
| GPU | FP32, FP16 |
| NPU (includes Hexagon DSP, HTP) | FP16*, INT16, INT8 |
*Some older chipsets do not support fp16 inference on their NPU.
- Snapdragon 8 Elite Gen 5, 8 Elite, 8 Gen 3, 8 Gen 2, and 8 Gen 1 Mobile Platforms
- Snapdragon X2 Elite, Snapdragon X Elite Compute Platforms
- SA7255P, SA8295P, and SA8775P Automotive Platforms
- QCS 6490, QCS 8250, QCS 9075, and QCS 8550 IoT Platforms
- QCS8450 XR Platform
and many more.
- Samsung Galaxy S21, S22, S23, S24, and S25 Series
- Xiaomi 12, 13, 15, and 17
- Snapdragon X Elite CRD and Snapdragon X2 Elite CRD (Compute Reference Device)
- Qualcomm RB3 Gen 2, RB5 Gen 2, IQ-8, IQ-9
and many more.
Want to onboard your own model? Follow the instructions in EXTERNAL_ONBOARDING.md to create a new model recipe using Claude.
Slack: https://aihub.qualcomm.com/community/slack
GitHub Issues: https://github.com/qualcomm/ai-hub-models/issues
Email: [email protected].
Qualcomm® AI Hub Models is licensed under BSD-3. See the LICENSE file.
