Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Making models smaller and faster: quantization, distillation, pruning, sparsity and kernel-level work.
Signals: quantization, model-compression, pruning, knowledge-distillation, gptq, awq, bitsandbytes, sparsity
184 results
Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.
Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".
Code for the ALiBi method for transformer language models (ICLR 2022)
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Codebase for Merging Language Models (ICML 2024)
Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models
YaRN: Efficient Context Window Extension of Large Language Models
Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. Orion-14B 系列模型包括一个具有140亿参数的多语言基座大模型以及一系列相关的衍生模型，包括对话模型，长文本模型，量化模型，RAG微调模型，Agent微调模型等。
TinyChatEngine: On-Device LLM Inference Library
Model Compression Toolbox for Large Language Models and Diffusion Models
A curated list of awesome edge machine learning resources, including research papers, inference engines, challenges, books, meetups and others.
NeuralFoil is a practical airfoil aerodynamics analysis tool using physics-informed machine learning, exposed to end-users in pure Python/NumPy.
Awesome machine learning model compression research papers, quantization, tools, and learning material.
constrained nonlinear optimization for scientific machine learning, UQ, and AI
Python package for Bayesian Machine Learning with scikit-learn API
Infrastructures™ for Machine Learning Training/Inference in Production.
Spearmint is a package to perform Bayesian optimization according to the algorithms outlined in the paper: Practical Bayesian Optimization of Machine Learning Algorithms. Jasper Snoek, Hugo Larochelle and Ryan P. Adams. Advances in Neural Information Processing Systems, 2012
(AAAI' 20) A Python Toolbox for Machine Learning Model Combination
Infrastructure for Machine Learning Guided Optimization (MLGO) in LLVM.
Python package for stacking (machine learning technique)
Implementation of Bayesian Hyperparameter Optimization of Machine Learning Algorithms
Homomorphic machine learning
This repository is for my YT video series about optimizing a Tensorflow deep learning model using TensorRT. We demonstrate optimizing LeNet-like model and YOLOv3 model, and get 3.7x and 1.5x faster for the former and the latter, respectively, compared to the original models.
AKG (Auto Kernel Generator) is an optimizer for operators in Deep Learning Networks, which provides the ability to automatically fuse ops with specific patterns.
24,523 repositories in the index in total.
