Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Adapting pretrained models: PEFT/LoRA, instruction tuning, RLHF, DPO and preference alignment.
Signals: fine-tuning, finetuning, lora, peft, qlora, rlhf, dpo, instruction-tuning
284 results
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
This repository contains different LLM chatbot projects (RAG, LLM agents, etc.) and well-known techniques for training and fine tuning LLMs.
[ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333
Paper accepted by CIKM 2024. Codes of GongBU, a LLM fine-tuning platform for domain-specific adaptation.
Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs). Perfect for ML practitioners and researchers!
Framework that enables fine-tuning of vision-language grounding models on custom datasets
Fast & Simple repository for pre-training and fine-tuning T5-style models
Efficient Training (including pre-training and fine-tuning) for Big Models
Code for fine-tuning Platypus fam LLMs using LoRA
Fine-Tuning your VITS model using a pre-trained model
:zap: The most powerful open source tweaker on GitHub for fine-tuning Windows 10 & Windows 11
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
Fine-tune Segment-Anything Model with Lightning Fabric.
Fine-tune mistral-7B on 3090s, a100s, h100s
A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.
Fine-Tuning Embedding for RAG with Synthetic Data
:control_knobs: Compact GUI for fine-tuning parameters and monitoring value changes
[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
The official implementation of Self-Play Fine-Tuning (SPIN)
Robust fine-tuning of zero-shot models
Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"
250+ Fine-tuning & RL Notebooks for text, vision, audio, embedding, TTS models.
24,523 repositories in the index in total.
