Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
ETL, document parsing, web crawling, synthetic data generation, annotation and dataset curation tooling.
Signals: data-engineering, etl, data-pipeline, web-scraping, crawler, data-labeling, annotation-tool, synthetic-data
473 results
Collection of open-source libraries and tools for Robotic Process Automation (RPA), designed to be used with both Robot Framework and Python
A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files
A web privacy measurement framework
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Synthetic fraud graph generator for benchmarking graph-based fraud detection models in financial services.
Benchmarking synthetic data generation methods.
The unix-way web crawler
HTTP client that can impersonate web browser tls/http2 fingerprints
Free anti fingerprint browser, 指纹浏览器, 隐私浏览器, 防识别浏览器, 反识别浏览器, 防关联浏览器, 免费的web3空投专用指纹浏览器 https://virtualbrowser.cc/?src=github
Declarative data automation language and Go runtime for structured extraction workflows.
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
The API to search, scrape, and interact with the web at scale. 🔥
Configs and boilerplates for Label Studio's Machine Learning backend
Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
DataMate is an enterprise-level data processing platform designed for model fine-tuning and RAG retrieval.
PyMuPDF4LLM
Easy Data Preparation with latest LLMs-based Operators and Pipelines.
RMT (RuoMengTu) is a free, open-source macro tool built on AHKv2. Let the code handle the tedious work—you have more meaningful things to do.
Copy any text on your screen, stop retyping.
Conditional GAN for generating synthetic tabular data.
Python Toolkit for Causal and Probabilistic Reasoning
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.
Get web data for AI agents and LLMs
24,523 repositories in the index in total.
