Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Runtimes and servers that execute model inference at speed and scale.
Signals: llm-inference, inference, inference-engine, model-serving, llm-serving, llama-cpp, vllm, triton-inference-server
410 results
Acceleration package for neural networks on multi-core CPUs
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Advbox is a toolbox to generate adversarial examples that fool neural networks in PaddlePaddle、PyTorch、Caffe2、MxNet、Keras、TensorFlow and Advbox can benchmark the robustness of machine learning models. Advbox give a command line tool to generate adversarial examples with Zero-Coding.
A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.
Deep Learning Visualization Toolkit（『飞桨』深度学习可视化工具 ）
Remove backgrounds from images directly in the browser environment with ease and no additional costs or privacy concerns. Explore an interactive demo.
AI Image Toolkit that runs fully in your browser — free, private, and offline-first.
Lightweight nudity detection
Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Unified framework for building enterprise RAG pipelines with small, specialized models
Highly optimized inference engine for Binarized Neural Networks
Machine Learning inference engine for Microcontrollers and Embedded devices
Run TensorFlow models in C++ without installation and without Bazel
Bolt is a deep learning library with high performance and heterogeneous flexibility.
The challenge projects for Inferencing machine learning models on iOS
Use AnimeGANv3 to make your own animation works, including turning photos or videos into anime.
GUI for upscaling ONNX models with NVIDIA TensorRT and Vapoursynth
The project can achieve FCWS, LDWS, and LKAS functions solely using only visual sensors. using YOLOv5 / YOLOv5-lite / YOLOv6 / YOLOv7 / YOLOv8 / YOLOv9 / EfficientDet and Ultra-Fast-Lane-Detection-v2 .
volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.
🚀 Deep learning includes superpoint-superglue(C++, TensorRT), and traditional algorithms include zkaze, surf, ORB, etc.
基于CenterNet训练的目标检测&人脸对齐&姿态估计模型
C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ONNX Runtime, LibTorch, TensorFlow
Reimplement RetinaFace use C++ and TensorRT
24,535 repositories in the index in total.
