Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Released model weights, reference implementations and architecture research.
Signals: large-language-models, llm, foundation-models, transformer, gpt, llama, mistral, qwen
1,455 results
[EMNLP'2024] "OpenGraph: Towards Open Graph Foundation Models"
(CVPR 2022) Pytorch implementation of "Self-supervised transformers for unsupervised object discovery using normalized cut"
[ICLR 2023] "Is Attention All NeRF Needs?" by Mukund Varma T*, Peihao Wang* , Xuxi Chen, Tianlong Chen, Subhashini Venugopalan, Zhangyang Wang
Lumen 10 基础上扩展出的API 启动项目，精心设计的目录结构，规范统一的响应数据格式，Repository 模式架构的最佳实践。
[NeurIPS'22] Tokenized Graph Transformer (TokenGT), in PyTorch
Advanced TypeScript runtime reflection system
PyTorch Implementation of OpenAI GPT-2
[ECCV2024 Oral🔥] Official Implementation of "GiT: Towards Generalist Vision Transformer through Universal Language Interface"
The official implementation for "Spherical Transformer for LiDAR-based 3D Recognition" (CVPR 2023).
Code & Data for "Tabular Transformers for Modeling Multivariate Time Series" (ICASSP, 2021)
LLaMa/RWKV onnx models, quantization and testcase
Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
Official repo for Medical Image Segmentation Review: The Success of U-Net
RXNMapper: Unsupervised attention-guided atom-mapping. Code complementing our Science Advances publication on "Extraction of organic chemistry grammar from unsupervised learning of chemical reactions" (https://advances.sciencemag.org/content/7/15/eabe4166).
LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.
A PyTorch implementation of "CoAtNet: Marrying Convolution and Attention for All Data Sizes"
A complete GPT language model (training and inference) in ~600 lines of pure C#, zero dependencies
A typescript transformer that automatically generates validation code from your types.
Abstractive summarisation using Bert as encoder and Transformer Decoder
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"
TypeScript transformer for improving the debugging experience of styled-components
A tool that can transform CommonJS to ESM
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
24,540 repositories in the index in total.
