magpie-align/magpie
quality grade D, 48 out of 100[ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data generation pipeline!
- stars
- 876
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Adapting pretrained models: PEFT/LoRA, instruction tuning, RLHF, DPO and preference alignment.
Signals: fine-tuning, finetuning, lora, peft, qlora, rlhf, dpo, instruction-tuning
284 results
[ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data generation pipeline!
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
Catch2, Google Test and doctest Adapter for the VSCode
The most easy-to-understand tutorial for using LoRA (Low-Rank Adaptation) within diffusers framework for AI Generation Researchers🔥
OneTrainer is a one-stop solution for all your Diffusion training needs.
Zero-friction LLM fine-tuning skill for Claude Code, Gemini CLI & any ACP agent. Unsloth on NVIDIA · TRL+MPS/MLX on Apple Silicon. Automates env setup, LoRA training (SFT, DPO, GRPO, vision), post-hoc GRPO log diagnostics, evaluation, and export end-to-end. Part of the Gaslamp AI platform.
VibeVoiceFusion is a full-stack, multi-speaker voice generation web system featuring LoRA fine-tuning, batch generation, and VRAM optimization. Based on Microsoft's VibeVoice (AR + diffusion architecture)
Webui for using XTTS and for finetuning it
A Repo to store the Google Colaboratory Notebooks that I have created and shared
A short tutorial on performing fine tuning or transfer learning in PyTorch.
Align Anything: Training All-modality Model with Feedback
Phi-4 for Mac: Locally-run Vision and Language Models for Apple Silicon
[Fully open] [Encoder-free MLLM] Vision as LoRA
[CVPR' 2026] JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimization
singing voice change based on whisper, and lora for singing voice clone
Generate, animate and schedule your AI characters 🤖
⚠️ Legacy repository for Geti v2.x. For Geti v3.0+, visit https://github.com/open-edge-platform/geti
Collection of awesome parameter-efficient fine-tuning resources.
This repository implements a demo of the networks described in "How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)" paper.
The official PyTorch implementation of Towards Fast, Accurate and Stable 3D Dense Face Alignment, ECCV 2020.
24,523 repositories in the index in total.