Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Runtimes and servers that execute model inference at speed and scale.
Signals: llm-inference, inference, inference-engine, model-serving, llm-serving, llama-cpp, vllm, triton-inference-server
411 results
📚 Introduction to Modern Statistics - A college-level open-source textbook with a modern approach highlighting multivariable relationships and simulation-based inference.
Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
Acceleration package for neural networks on multi-core CPUs
ONNXMLTools enables conversion of models to ONNX
Advbox is a toolbox to generate adversarial examples that fool neural networks in PaddlePaddle、PyTorch、Caffe2、MxNet、Keras、TensorFlow and Advbox can benchmark the robustness of machine learning models. Advbox give a command line tool to generate adversarial examples with Zero-Coding.
A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.
Deep Learning Visualization Toolkit（『飞桨』深度学习可视化工具 ）
Remove backgrounds from images directly in the browser environment with ease and no additional costs or privacy concerns. Explore an interactive demo.
A collection of pre-trained, state-of-the-art models in the ONNX format
AI Image Toolkit that runs fully in your browser — free, private, and offline-first.
Lightweight nudity detection
Highly optimized inference engine for Binarized Neural Networks
Machine Learning inference engine for Microcontrollers and Embedded devices
Run TensorFlow models in C++ without installation and without Bazel
Bolt is a deep learning library with high performance and heterogeneous flexibility.
The challenge projects for Inferencing machine learning models on iOS
Use AnimeGANv3 to make your own animation works, including turning photos or videos into anime.
The project can achieve FCWS, LDWS, and LKAS functions solely using only visual sensors. using YOLOv5 / YOLOv5-lite / YOLOv6 / YOLOv7 / YOLOv8 / YOLOv9 / EfficientDet and Ultra-Fast-Lane-Detection-v2 .
volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.
🚀 Deep learning includes superpoint-superglue(C++, TensorRT), and traditional algorithms include zkaze, surf, ORB, etc.
基于CenterNet训练的目标检测&人脸对齐&姿态估计模型
C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ONNX Runtime, LibTorch, TensorFlow
Reimplement RetinaFace use C++ and TensorRT
Based on tensorrt v8.0+, deploy detection, pose, segment, tracking of YOLO11 with C++ and python api.
24,545 repositories in the index in total.
