ZigeW/data_management_LLM
quality grade F, 34 out of 100Collection of training data management explorations for large language models
- stars
- 343
- stars gained this week
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Core deep-learning frameworks and libraries for pretraining and distributed training.
Signals: deep-learning, neural-network, pytorch, tensorflow, jax, distributed-training, training, deepspeed
2,663 results
Collection of training data management explorations for large language models
Train a language model to answer Slack messages as you.
ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Models
An efficient framework for collaborative training of large language models
Fully Open Language Models with Stellar Performance
Large-scale language modeling tutorials with PyTorch
[T-PAMI 2025] PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm
The official repo for [JSTARS'24] "MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretraining"
The official repo for [TGRS'22] "Advancing Plain Vision Transformer Towards Remote Sensing Foundation Model"
🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
RL starter files in order to immediately train, visualize and evaluate an agent without writing any line of code
AxisRL is an agentic RL post-training framework built on SGLang rollout, Megatron training, and real-world agent workflows.
ToolOrchestra is an end-to-end RL training framework for orchestrating tools and agentic workflows.
Arnold - DOOM Agent
🤗🖼️ HuggingPics: Fine-tune Vision Transformers for anything using images found on the web.
A MemAgent framework that can be extrapolated to 3.5M, along with a training framework for RL training of any agent workflow.
An artificial intelligence platform for the StarCraft II with large-scale distributed training and grand-master agents.
A batteries-included kit for knowledge graphs
VyvoTTS: LLM-Based Text-to-Speech Training Framework
Deep Voice: Real-time Neural Text-to-Speech
Your AI Game Dev Hub. The ultimate resource hub for AI-powered game development tools. Discover cutting-edge LLMs, World Model, Agent, Code, Image, Texture, Shader, 3D Model, Animation, Video, Audio, Music, Singing Voice and Analytics. 🔥
Private local model studio, AI chat, and agent workspace powered by WebGPU and WebLLM.
This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
distributed trainer for LLMs
24,545 repositories in the index in total.