Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Adapting pretrained models: PEFT/LoRA, instruction tuning, RLHF, DPO and preference alignment.
Signals: fine-tuning, finetuning, lora, peft, qlora, rlhf, dpo, instruction-tuning
281 results
visualization code for 3D human body annotation by EFT (Exemplar Fine-tuning)
Implementation of "SVDiff: Compact Parameter Space for Diffusion Fine-Tuning"
SplitFM: A Split Parameter-Efficient Fine-Tuning and Inference Framework for Foundation Models
[NeurIPS 2025]⭐️ Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning.
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
🐢 💨 Speedup your MacOS setup with this fine tuning settings
The Fastest Way to Fine-Tune LLMs Locally
Easy and Efficient dLLM Fine-Tuning
GPT Fine-Tuning using Node.js - an easy to use starter project
Fine-tuning code for CLIP models
LLM fine-tuning and eval
Quick exploration into fine tuning florence 2
Fine-tuning LLMs using QLoRA
Hands-on tutorials on fine-tuning various LLMs using different fine-tuning techniques
[NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other models
The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"
PromptCBLUE: a large-scale instruction-tuning dataset for multi-task and few-shot learning in the medical domain in Chinese
[ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
Shepherd: A foundational framework enabling federated instruction tuning for large language models
🐙 OctoPack: Instruction Tuning Code Large Language Models
MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
24,545 repositories in the index in total.
