Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Released model weights, reference implementations and architecture research.
Signals: large-language-models, llm, foundation-models, transformer, gpt, llama, mistral, qwen
1,475 results
A complete GPT language model (training and inference) in ~600 lines of pure C#, zero dependencies
A typescript transformer that automatically generates validation code from your types.
Abstractive summarisation using Bert as encoder and Transformer Decoder
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
TypeScript transformer for improving the debugging experience of styled-components
A tool that can transform CommonJS to ESM
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
Train a tiny Transformer from scratch on your iMessage history, entirely on your Mac.
eLLM can infer LLM on CPUs faster than on GPUs
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
Stratified Transformer for 3D Point Cloud Segmentation (CVPR 2022)
No description
Guideline following Large Language Model for Information Extraction
CTNet: A Convolutional Transformer Network for EEG-Based Motor Imagery Classification
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links
[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"
[ICCV 2023 & TPAMI 2026] SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videos
一个执着于让CPU\端侧-Model逼近GPU-Model性能的项目，CPU上的实时率(RTF)小于0.1
Implementation of Transformer Model in Tensorflow
ChatGPT-Pro is an advanced application that combines the power of ChatGPT and DALL.E.
ChineseNMT: Translate English to Chinese with PyTorch Implementation of Transformer
MetaFormer Baselines for Vision (TPAMI 2024)
24,523 repositories in the index in total.
