Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
ETL, document parsing, web crawling, synthetic data generation, annotation and dataset curation tooling.
Signals: data-engineering, etl, data-pipeline, web-scraping, crawler, data-labeling, annotation-tool, synthetic-data
464 results
☁️ The fastest HTML to markdown convertor on GitHub. Optimized for LLMs and supports streaming.
Synthetic data generation for tabular data
Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the context API for AI agents.
MORT 번역기 프로젝트 - Real-time game translator with OCR
🧙 Build, run, and manage data pipelines for integrating and transforming data.
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Note Companion: AI assistant for Obsidian that goes beyond just a chat. (prev File Organizer 2000)
A Gtk/Qt front-end to tesseract-ocr.
Privacy and Security focused Segment-alternative, in Golang and React
A search engine that "just works" for Obsidian.
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.
The machine learning toolkit for time series analysis in Python
Twitter scraper for X: tweets, profiles, followers and following, no API key needed. Python library with multi-account pooling, proxy support and async, or a hosted version on Apify.
An iOS OCR Server Using Apple’s Vision Framework
Mount Hugging Face Buckets and repos as local filesystems. No download, no copy, no waiting.
docTR (Document Text Recognition) - a seamless, high-performing & accessible library for OCR-related tasks powered by Deep Learning. Ongoing development and maintenance by t2k.
MockServer is an HTTP(S) mock server and proxy for testing that lets you mock APIs, inspect and modify live traffic, and inject failures. It supports HTTP/1.1, HTTP/2, gRPC, WebSockets, TCP and more on a single port, with additional support for HTTP/3, message brokers, and AI/LLM APIs.
Convert Java to JSON/TOON and back. Supports complex object graphs, cyclic references, and TOON format for 40-50% LLM token savings. JDK 8+
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
Label Objects and Save Time (LOST) - Design your own smart Image Annotation process in a web-based environment.
A Python wrapper for the tesseract-ocr API
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
24,545 repositories in the index in total.
