Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
ETL, document parsing, web crawling, synthetic data generation, annotation and dataset curation tooling.
Signals: data-engineering, etl, data-pipeline, web-scraping, crawler, data-labeling, annotation-tool, synthetic-data
464 results
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
The fastest business intelligence tool for humans and agents.
Synthetic Patient Population Simulator
Free anti fingerprint browser, 指纹浏览器, 隐私浏览器, 防识别浏览器, 反识别浏览器, 防关联浏览器, 免费的web3空投专用指纹浏览器 https://virtualbrowser.cc/?src=github
截屏 离线OCR 搜索翻译 以图搜图 贴图 录屏 万向滚动截屏 屏幕翻译 Screenshot Offline OCR Search Translate Search for picture Paste the picture on the screen Screen recorder Omnidirectional scrolling screenshot Screen translator 支持Windows Linux macOS
Scan documents to PDF and more, as simply as possible.
OCR model that handles complex tables, forms, handwriting with full layout.
🎨 NeMo Data Designer: Generate high-quality synthetic data from scratch or from seed data.
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.
Use OCR in Windows quickly and easily with Text Grab. With optional background process and notifications.
A curated collection of the best free, freemium, and paid APIs for developers.
一键中文数据增强包 ； NLP数据增强、bert数据增强、EDA：pip install nlpcda
PDF craft can convert PDF files into various other formats. This project will focus on processing PDF files of scanned books.
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.
Transform Web Content into LLM-Ready Data
Real-time detection of anti-bot systems, captchas & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.
The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
Open-source screenshot and screen recording for macOS. The free, native alternative to CleanShot X. Built with Swift 6.0 and SwiftUI.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
在保留版面、公式与结构的前提下进行 PDF 翻译，适用于科研与技术文档
A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files
24,545 repositories in the index in total.
