Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Adapting pretrained models: PEFT/LoRA, instruction tuning, RLHF, DPO and preference alignment.
Signals: fine-tuning, finetuning, lora, peft, qlora, rlhf, dpo, instruction-tuning
283 results
[IEEE TPAMI] Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning
This is an official repo for fine-tuning SAM to customized medical images.
Practical, Colab-friendly notebooks for fine-tuning and running audio AI models
visualization code for 3D human body annotation by EFT (Exemplar Fine-tuning)
Implementation of "SVDiff: Compact Parameter Space for Diffusion Fine-Tuning"
SplitFM: A Split Parameter-Efficient Fine-Tuning and Inference Framework for Foundation Models
[NeurIPS 2025]⭐️ Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning.
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
🐢 💨 Speedup your MacOS setup with this fine tuning settings
The Fastest Way to Fine-Tune LLMs Locally
GPT Fine-Tuning using Node.js - an easy to use starter project
Fine-tuning code for CLIP models
LLM fine-tuning and eval
Quick exploration into fine tuning florence 2
Fine-tuning LLMs using QLoRA
Hands-on tutorials on fine-tuning various LLMs using different fine-tuning techniques
[NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other models
The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"
PromptCBLUE: a large-scale instruction-tuning dataset for multi-task and few-shot learning in the medical domain in Chinese
[ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
Shepherd: A foundational framework enabling federated instruction tuning for large language models
🐙 OctoPack: Instruction Tuning Code Large Language Models
24,535 repositories in the index in total.
