Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
ETL, document parsing, web crawling, synthetic data generation, annotation and dataset curation tooling.
Signals: data-engineering, etl, data-pipeline, web-scraping, crawler, data-labeling, annotation-tool, synthetic-data
464 results
Synthetic Data SDK ✨
Annif is a multi-algorithm automated subject indexing tool for libraries, archives and museums.
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API credentials. Enable live search, inject HTML context, and automate intelligent scraper ChatGPT workflows in just a few parameters.
An ergonomic, privacy-aware Python HTTP Client
Declarative data automation language and Go runtime for structured extraction workflows.
Reverb is an efficient and easy-to-use data storage and transport system designed for machine learning research
Advanced real-time screen translator for games, hardcoded subtitles in videos, static text and etc.
Fast, offline OCR for Node.js & C++. PP-OCRv6 with Core ML / WebGPU hardware acceleration — recognize text in images with confidence scores & coordinates. npm: @arcships/light-ocr
List of libraries, tools and APIs for web scraping and data processing.
Machine learning with dataframes
Universal LaTeX document skill for Claude Code: 27 templates, 27 scripts, 26 reference guides. Made with Claude Code on ✦ HappyCapy AI ✦ platform
GLM-OCR: Accurate × Fast × Comprehensive
Desktop app for managing BibTeX and BibLaTeX (.bib) libraries
TurboOCR, >200 img/s OmnidocBench. TensorRT FP16, PP-OCRv6, HTTP + gRPC
A Python-embedded modeling language for convex optimization problems.
A stand-alone implementation of several NumPy dtype extensions used in machine learning.
RMT (RuoMengTu) is a free, open-source macro tool built on AHKv2. Let the code handle the tedious work—you have more meaningful things to do.
PyMuPDF4LLM
An open lakehouse engine — Postgres-native, vector-native and Python-native. Speaks PostgreSQL, runs on your object storage, written in Rust.
Pure-Rust, CPU-only OCR engine for Baidu Unlimited-OCR (a DeepSeek-OCR-derived 3B MoE VLM). Five-model zoo, custom int8 kernels, no ML framework, no Python, no GPU.
All-in-One Development Tool based on PaddlePaddle
Open Source Agentic Business Intelligence with Malloy Semantic Layer :tada:
24,545 repositories in the index in total.
