Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Runtimes and servers that execute model inference at speed and scale.
Signals: llm-inference, inference, inference-engine, model-serving, llm-serving, llama-cpp, vllm, triton-inference-server
410 results
Based on tensorrt v8.0+, deploy detection, pose, segment, tracking of YOLO11 with C++ and python api.
SuperPoint and SuperGlue with TensorRT. Deploy with C++.
Convert pointpillars Pytorch Model To ONNX for TensorRT Inference
This repository is forked from shouxieai/tensorRT_Pro, extending it to support a wide range of vision models with high-performance TensorRT C++ inference.
A project that optimizes OWL-ViT for real-time inference with NVIDIA TensorRT.
Sample apps to demonstrate how to deploy models trained with TAO on DeepStream
Image classification with NVIDIA TensorRT from TensorFlow models.
Efficient CPU/GPU ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, ArtCNN and more!)
C++ TensorRT implementation of Depth-Anything V1, V2
TensorRT for Yolov3
A c++ implementation of yolov5 and deepsort
GPU accelerated deep learning inference applications for RaspberryPi / JetsonNano / Linux PC using TensorflowLite GPUDelegate / TensorRT
[ICLR 2020] "FasterSeg: Searching for Faster Real-time Semantic Segmentation" by Wuyang Chen, Xinyu Gong, Xianming Liu, Qian Zhang, Yuan Li, Zhangyang Wang
TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据
A library for high performance deep learning inference on NVIDIA GPUs.
This repo is implemented based on detectron2 and centernet
convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.
A Wide Range of Custom Functions for YOLOv4, YOLOv4-tiny, YOLOv3, and YOLOv3-tiny Implemented in TensorFlow, TFLite, and TensorRT.
InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.
基于深度学习的肿瘤辅助诊断系统，以图像分割为核心，利用人工智能完成肿瘤区域的识别勾画并提供肿瘤区域的特征来辅助医生进行诊断。有完整的模型构建、后端架设、工业级部署和前端访问功能。TensorRT、PyTorch 、OpenCV 、Flask、Vue
PyTorch Project Specification.
Deploy your model with TensorRT quickly.
Adlik: Toolkit for Accelerating Deep Learning Inference
A distilled Segment Anything (SAM) model capable of running real-time with NVIDIA TensorRT
24,535 repositories in the index in total.
