Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Adapting pretrained models: PEFT/LoRA, instruction tuning, RLHF, DPO and preference alignment.
Signals: fine-tuning, finetuning, lora, peft, qlora, rlhf, dpo, instruction-tuning
283 results
High Accuracy and efficiency multi-task fine-tuning framework for Code LLMs. This work has been accepted by KDD 2024.
Quick Start for Large Language Models (Theoretical Learning and Practical Fine-tuning) 大语言模型快速入门（理论学习与微调实战）
AgentCPM-GUI: An on-device GUI agent for operating Android apps, enhancing reasoning ability with reinforcement fine-tuning for efficient task execution.
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
This repository contains different LLM chatbot projects (RAG, LLM agents, etc.) and well-known techniques for training and fine tuning LLMs.
[ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333
Paper accepted by CIKM 2024. Codes of GongBU, a LLM fine-tuning platform for domain-specific adaptation.
Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs). Perfect for ML practitioners and researchers!
Estimate whether a Hugging Face model fits and fine-tunes on your local GPU.
Framework that enables fine-tuning of vision-language grounding models on custom datasets
Fast & Simple repository for pre-training and fine-tuning T5-style models
Efficient Training (including pre-training and fine-tuning) for Big Models
Code for fine-tuning Platypus fam LLMs using LoRA
Fine-Tuning your VITS model using a pre-trained model
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
Fine-tune Segment-Anything Model with Lightning Fabric.
Fine-tune mistral-7B on 3090s, a100s, h100s
A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.
Fine-Tuning Embedding for RAG with Synthetic Data
:control_knobs: Compact GUI for fine-tuning parameters and monitoring value changes
[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
24,535 repositories in the index in total.
