meridianlabs-ai/inspect_petri
quality grade B, 78 out of 100An alignment auditing agent capable of quickly exploring alignment hypothesis
- stars
- 1.4k
- stars gained this week
- +7this week
- forks, open issues and contributors
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Adapting pretrained models: PEFT/LoRA, instruction tuning, RLHF, DPO and preference alignment.
Signals: fine-tuning, finetuning, lora, peft, qlora, rlhf, dpo, instruction-tuning
281 results
An alignment auditing agent capable of quickly exploring alignment hypothesis
Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.
The unofficial OpenAI SDK for Dart & Flutter. Full API coverage + OpenAI-compatible providers (Azure, DeepSeek, LM Studio, Ollama): Responses, Chat, Realtime, Videos, Batch, Fine-tuning.
:sparkles::sparkles:Latest Advances on Multimodal Large Language Models
Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (LLM).
Communicate Freely
ACP adapter for pi coding agent
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
A project to improve skills of large language models
OneTrainer is a one-stop solution for all your Diffusion training needs.
A PyTorch coding practice platform — covering LLM, Diffusion, PEFT, and more A friendly environment to help you deeply understand deep learning components through hands-on practice. Like LeetCode, but for tensors. Self-hosted. Supports both Jupyter and Web interfaces.
Library for sequence-to-sequence numeric prediction, applicable to any tokenizable input, and allows pretraining and fine-tuning over multiple tasks.
streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
最容易上手的0门槛 chatglm3 & agent & langchain 项目
The implementation of “Fine-tuning Graph Neural Networks by Preserving Graph Generative Patterns”
Implementation for <Large-Margin Softmax Loss for Convolutional Neural Networks> in ICML'16.
Official implementation of Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learning
[ECCV 2026] Official Code of "Distribution Matching Distillation Meets Reinforcement Learning"
This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"
A library that integrates huggingface transformers with the world of fastai, giving fastai devs everything they need to train, evaluate, and deploy transformer specific models.
Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed
No description
Inference, Fine Tuning and many more recipes with Gemma family of models
24,545 repositories in the index in total.