Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Released model weights, reference implementations and architecture research.
Signals: large-language-models, llm, foundation-models, transformer, gpt, llama, mistral, qwen
1,442 results
Advanced TypeScript runtime reflection system
PyTorch Implementation of OpenAI GPT-2
[ECCV2024 Oral🔥] Official Implementation of "GiT: Towards Generalist Vision Transformer through Universal Language Interface"
The official implementation for "Spherical Transformer for LiDAR-based 3D Recognition" (CVPR 2023).
LLaMa/RWKV onnx models, quantization and testcase
Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
Official repo for Medical Image Segmentation Review: The Success of U-Net
RXNMapper: Unsupervised attention-guided atom-mapping. Code complementing our Science Advances publication on "Extraction of organic chemistry grammar from unsupervised learning of chemical reactions" (https://advances.sciencemag.org/content/7/15/eabe4166).
LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.
A PyTorch implementation of "CoAtNet: Marrying Convolution and Attention for All Data Sizes"
A complete GPT language model (training and inference) in ~600 lines of pure C#, zero dependencies
A typescript transformer that automatically generates validation code from your types.
Abstractive summarisation using Bert as encoder and Transformer Decoder
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
TypeScript transformer for improving the debugging experience of styled-components
A tool that can transform CommonJS to ESM
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
Train a tiny Transformer from scratch on your iMessage history, entirely on your Mac.
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
Stratified Transformer for 3D Point Cloud Segmentation (CVPR 2022)
Guideline following Large Language Model for Information Extraction
CTNet: A Convolutional Transformer Network for EEG-Based Motor Imagery Classification
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
24,545 repositories in the index in total.
