Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Core deep-learning frameworks and libraries for pretraining and distributed training.
Signals: deep-learning, neural-network, pytorch, tensorflow, jax, distributed-training, training, deepspeed
2,663 results
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Guide to using pre-trained large language models of source code
Empower Sequence Labeling with Task-Aware Language Model
博客配套视频链接: https://space.bilibili.com/383551518?spm_id_from=333.1007.0.0 b 站直接看 配套 github 链接：https://github.com/nickchen121/Pre-training-language-model 配套博客链接：https://www.cnblogs.com/nickchen121/p/15105048.html
Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence
[ICLR 2025 Spotlight] Official implementation of "Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts"
Code to pretrain, fine-tune, and evaluate DreamZero and run sim & real-world evals
[COLM 2025] Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources
Implementation of Classifier Free Guidance in Pytorch, with emphasis on text conditioning, and flexibility to include multiple text embedding models
Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning, training, and prompt engineering examples. A bonus section with ChatGPT, GPT-3.5-turbo, GPT-4, and DALL-E including jump starting GPT-4, speech-to-text, text-to-speech, text to image generation with DALL-E, Google Cloud AI,HuggingGPT, and more
[ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)
Official PyTorch implementation of ODISE: Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models [CVPR 2023 Highlight]
Train high-quality text-to-image diffusion models in a data & compute efficient manner
Using Diffusion Models to Segment/Reconstruct Organs from Medical Images [AAAI Most influential Paper]
Label-Efficient Semantic Segmentation with Diffusion Models (ICLR'2022)
Audio generation using diffusion models, in PyTorch.
Diffusion Models in Medical Imaging (Published in Medical Image Analysis Journal)
The library contains a number of interconnected Java packages that implement machine learning and artificial intelligence algorithms. These are artificial intelligence algorithms implemented for the kind of people that like to implement algorithms themselves.
A standardized Python API with necessary preprocessing, machine learning and explainability tools to facilitate graph-analytics in computational pathology.
A machine learning project. Turn on your webcam. Mona Lisa's eyes will follow you around.
.NET bindings for PyTorch. Machine Learning with C# / F# with Multi-GPU/CPU support
Simple machine learning library / 簡單易用的機器學習套件
DeepHyper: A Python Package for Massively Parallel Hyperparameter Optimization in Machine Learning
Website for "A Survey of Machine Learning for Big Code and Naturalness"
24,545 repositories in the index in total.
