Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Runtimes and servers that execute model inference at speed and scale.
Signals: llm-inference, inference, inference-engine, model-serving, llm-serving, llama-cpp, vllm, triton-inference-server
411 results
SuperPoint and SuperGlue with TensorRT. Deploy with C++.
Convert pointpillars Pytorch Model To ONNX for TensorRT Inference
A project that optimizes OWL-ViT for real-time inference with NVIDIA TensorRT.
Sample apps to demonstrate how to deploy models trained with TAO on DeepStream
Image classification with NVIDIA TensorRT from TensorFlow models.
Efficient CPU/GPU ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, ArtCNN and more!)
C++ TensorRT implementation of Depth-Anything V1, V2
TensorRT for Yolov3
A c++ implementation of yolov5 and deepsort
GPU accelerated deep learning inference applications for RaspberryPi / JetsonNano / Linux PC using TensorflowLite GPUDelegate / TensorRT
[ICLR 2020] "FasterSeg: Searching for Faster Real-time Semantic Segmentation" by Wuyang Chen, Xinyu Gong, Xianming Liu, Qian Zhang, Yuan Li, Zhangyang Wang
TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据
A library for high performance deep learning inference on NVIDIA GPUs.
This repo is implemented based on detectron2 and centernet
convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.
A Wide Range of Custom Functions for YOLOv4, YOLOv4-tiny, YOLOv3, and YOLOv3-tiny Implemented in TensorFlow, TFLite, and TensorRT.
InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.
基于深度学习的肿瘤辅助诊断系统，以图像分割为核心，利用人工智能完成肿瘤区域的识别勾画并提供肿瘤区域的特征来辅助医生进行诊断。有完整的模型构建、后端架设、工业级部署和前端访问功能。TensorRT、PyTorch 、OpenCV 、Flask、Vue
PyTorch Project Specification.
Deploy your model with TensorRT quickly.
Adlik: Toolkit for Accelerating Deep Learning Inference
A distilled Segment Anything (SAM) model capable of running real-time with NVIDIA TensorRT
PytorchAutoDrive: Segmentation models (ERFNet, ENet, DeepLab, FCN...) and Lane detection models (SCNN, RESA, LSTR, LaneATT, BézierLaneNet...) based on PyTorch with fast training, visualization, benchmarking & deployment help
Aim-bot based on AI for all FPS games
24,545 repositories in the index in total.
