llm-d/llm-d
quality grade A, 94 out of 100Achieve state of the art inference performance with modern accelerators on Kubernetes
- stars
- 4.6k
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Cluster scheduling, GPU sharing, serverless compute and the distributed execution layer.
Signals: gpu, cuda, distributed-computing, kubernetes, ray, slurm, serverless, hpc
651 results
Achieve state of the art inference performance with modern accelerators on Kubernetes
Modular cross-runtime WebGPU library for shaders, 3D scenes, GPU tensors, neural networks, and math viz
Secure and fast microVMs for serverless computing.
Diskless Kafka® on S3. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency. Multi-AZ Availability.
A toolkit to run Ray applications on Kubernetes
Appwrite® - complete cloud infrastructure for your web, mobile and AI apps. Including Auth, Databases, Storage, Functions, Messaging, Hosting, Realtime and more
FlashInfer: Kernel Library for LLM Serving
Bitwarden-compatible server running on Cloudflare Workers
Restate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.
Android in docker solution with noVNC supported, video recording, mcp server and AI-agent
Pulumi - Infrastructure as Code in any programming language 🚀
Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currently shipping Qwen3.6-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1× and 2× cards.
The leading workflow orchestration platform. Run stateful step functions and AI workflows on serverless, servers, or the edge.
The Cloud Native Control Plane
⛅️ Home to Wrangler, the CLI for Cloudflare Workers®
Chaos testing, network emulation, and stress testing tool for containers
Rivet Actors are the primitive for stateful workloads. Built for AI agents, collaborative apps, and durable execution.
Free4Chat provides the temporary boundary. Participants bring the capabilities.
A Kubernetes web UI that is fully-featured, user-friendly and extensible
an easy-to-use dynamic service discovery, configuration and service management platform for building AI cloud native applications.
🏖️ A serverless, open-source file hosting solution built on Cloudflare. Supports image hosting, secure file storage, and personal cloud drive capabilities.
Write Cloudflare Workers in 100% Rust via WebAssembly
Open3D: A Modern Library for 3D Data Processing
A scalable, distributed, collaborative, document-graph database, for the realtime web
24,535 repositories in the index in total.