Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Adapting pretrained models: PEFT/LoRA, instruction tuning, RLHF, DPO and preference alignment.
Signals: fine-tuning, finetuning, lora, peft, qlora, rlhf, dpo, instruction-tuning
281 results
AirLLM 2.8T LLM inference with single 4GB GPU
Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐，6 项渐进代码作业，掌握 LLM 全栈知识
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models
Textbook on reinforcement learning from human feedback
:zap: The most advanced PowerShell module on GitHub for fine-tuning Windows 11 & Windows 10
🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
Training Sparse Autoencoders on Language Models
Train and serve LLMs at extreme speed and massive throughput.
ONLYOFFICE DocSpace is a room-based collaborative platform which allows organizing a clear file structure depending on users' needs or project goals. Flexible access permissions and user roles allow fine-tuning the access to the whole space or separate rooms.
PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.
An MCP adapter that bridges the Abilities API to the Model Context Protocol, enabling MCP clients to discover and invoke WordPress plugin, theme, and core abilities programmatically.
Synthetic data curation for post-training and structured data extraction
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
One-click Portable Windows installation of 'AI-Toolkit by Ostris'
A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.
Train Large Language Models on MLX.
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
Catch2, Google Test and doctest Adapter for the VSCode
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
250+ Fine-tuning & RL Notebooks for text, vision, audio, embedding, TTS models.
An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
:zap: The most powerful open source tweaker on GitHub for fine-tuning Windows 10 & Windows 11
24,545 repositories in the index in total.
