Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
| Date | Stars |
|---|---|
| 2026-07-30 | 5740 |
| 2026-08-06 | 5773 |
| 2026-08-15 | 5794 |
| 2026-08-18 | 5801 |
| 2026-08-19 | 5804 |
| 2026-08-20 | 5809 |
| 2026-08-21 | 5815 |
| 2026-08-23 | 5818 |
| 2026-08-24 | 5821 |
| 2026-08-25 | 5827 |
| 2026-08-26 | 5831 |
| 2026-08-27 | 5836 |
| 2026-08-28 | 5838 |
| 2026-08-29 | 5841 |
| 2026-08-30 | 5841 |
| 2026-08-31 | 5844 |
| 2026-09-01 | 5847 |
| 2026-09-02 | 5851 |
| 2026-09-03 | 5855 |
| 2026-09-04 | 5857 |
| 2026-09-05 | 5859 |
| 2026-09-06 | 5860 |
| 2026-09-07 | 5863 |
| 2026-09-08 | 5866 |
| 2026-09-09 | 5866 |
| 2026-09-10 | 5869 |
| 2026-09-11 | 5872 |
| 2026-09-12 | 5880 |
| 2026-09-13 | 5885 |
| 2026-09-14 | 5895 |
| 2026-09-15 | 5911 |
| 2026-09-16 | 5940 |
| 2026-09-17 | 5949 |
| 2026-09-18 | 5956 |
| 2026-09-19 | 5968 |
| 2026-09-20 | 5974 |
| 2026-09-21 | 5981 |
| 2026-09-22 | 5987 |
| 2026-09-23 | 5990 |
| 2026-09-24 | 5995 |
| 2026-09-25 | 5999 |
| 2026-09-26 | 6001 |
| 2026-09-27 | 6003 |
| 2026-09-28 | 6031 |
| 2026-09-29 | 6046 |
| 2026-09-30 | 6051 |
| 2026-10-01 | 6054 |
| 2026-10-02 | 6057 |
| 2026-10-03 | 6064 |
| 2026-10-04 | 6071 |
| 2026-10-05 | 6076 |
| 2026-10-06 | 6082 |
| 2026-10-07 | 6082 |
| 2026-10-08 | 6089 |
| 2026-10-09 | 6094 |
| 2026-10-10 | 6097 |
| 2026-10-11 | 6100 |
| 2026-10-12 | 6104 |
| 2026-10-13 | 6108 |
| 2026-10-14 | 6111 |
| 2026-10-15 | 6118 |
| 2026-10-16 | 6120 |
| 2026-10-17 | 6123 |
| 2026-10-18 | 6127 |
| 2026-10-19 | 6131 |
| 2026-10-20 | 6136 |
| 2026-10-21 | 6143 |
| 2026-10-22 | 6144 |
| 2026-10-23 | 6146 |
| 2026-10-24 | 6149 |
| 2026-10-25 | 6155 |
| 2026-10-26 | 6159 |
| 2026-10-27 | 6162 |
| 2026-10-28 | 6164 |
| 2026-10-29 | 6169 |
| 2026-10-30 | 6173 |
| 2026-10-31 | 6177 |
| 2026-11-01 | 6181 |
| 2026-11-02 | 6182 |
| 2026-11-03 | 6183 |
| 2026-11-04 | 6187 |
Today
+4 stars today
This week
+23 stars this week
This month
+111 stars this month
Momentum
54.0
growth rate 0.37%/day
# KServe [](https://pkg.go.dev/github.com/kserve/kserve) [](https://goreportcard.com/report/github.com/kserve/kserve) [](https://bestpractices.coreinfrastructure.org/projects/6643) [](https://github.com/kserve/kserve/releases) [](https://github.com/kserve/kserve/blob/master/LICENSE) [](https://github.com/kserve/community/blob/main/README.md#questions-and-issues) [](https://gurubase.io/g/kserve) KServe is a standardized distributed generative and predictive AI inference platform for scalable, multi-framework deployment on Kubernetes. KServe is being [used by many organizations](https://kserve.github.io/website/docs/community/adopters) and is a [Cloud Native Computing Foundation (CNCF)](https://www.cncf.io/) incubating project. For more details, visit the [KServe website](https://kserve.github.io/website/).  ### Why KServe? Single platform that unifies Generative and Predictive AI inference on Kubernetes. Simple enough for quick deployments, yet powerful enough to handle enterprise-scale AI workloads with advanced features. ### Features **Generative AI** * 🧮 **Optimized Backends**: Support for vLLM and llm-d for optimized performance for serving LLMs * 📌 **Standardization**: OpenAI-compatible inference protocol for seamless integration with LLMs * 🚅 **GPU Acceleration**: High-performance serving with GPU support and optimized memory management for large models * 💾 **Model Caching**: Intelligent model caching to reduce loading times and improve response latency for frequently used models * 🗂️ **KV Cache Offloading**: Advanced memory management with KV cache offloading to CPU/disk for handling longer sequences efficiently * 📈 **Autoscaling**: Request-based autoscaling capabilities optimized for generative workload patterns * 🔧 **Hugging Face Ready**: Native support for Hugging Face models with streamlined deployment workflows **Predictive AI** * 🧮 **Multi-Framework**: Support for TensorFlow, PyTorch, scikit-learn, XGBoost, ONNX, and more * 🔀 **Intelligent Routing**: Seamless request routing between predictor, transformer, and explainer components with automatic traffic management * 🔄 **Advanced Deployments**: Canary rollouts, inference pipelines, and ensembles with InferenceGraph * ⚡ **Autoscaling**: Request-based autoscaling with scale-to-zero for predictive workloads * 🔍 **Model Explainability**: Built-in support for model explanations and feature attribution to understand prediction reasoning * 📊 **Advanced Monitoring**: Enables payload logging, outlier detection, adversarial detection, and drift detection * 💰 **Cost Efficient**: Scale-to-zero on expensive resources when not in use, reducing infrastructure costs ### Learn More To learn more about KServe, how to use various supported features, and how to participate in the KServe community, please follow the [KServe website documentation](https://kserve.github.io/website). Additionally, we have compiled a list of [presentations and demos](https://kserve.github.io/website/docs/community/presentations) to dive through various details. ### :hammer_and_wrench: Installation #### Standalone Installation - **[Standard Kubernetes Installation](https://kserve.github.io/website/docs/admin-guide/overview#raw-kubernetes-deployment)**: Compared to Serverless Installation, this is a more **lightweight** installation. However,
Excerpt of 5,878 characters
Read on GitHub
256
208
136
113
105
64
Filippe Spolti · Red Hat, Inc · Brazil
60
Animesh Singh
58
Yuan Tang · Red Hat · United States
56
53
Pierangelo Di Pilato · Red Hat · Italy
52
46
Clive Cox · United Kingdom
40
37
Vivek Karunai Kiri Ragavan · @RedHatOfficial · United States
36
36
Paul Van Eck · United States
34
28
Gang Pu · IBM
25
25
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:abd1b7d52c507ffb, topic:llm-inference, topic:model-serving, topic:vllm
matched fp:abd1b7d52c507ffb, topic:mlops, topic:kubeflow
matched fp:abd1b7d52c507ffb, topic:pytorch, topic:tensorflow