Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
ETL, document parsing, web crawling, synthetic data generation, annotation and dataset curation tooling.
Signals: data-engineering, etl, data-pipeline, web-scraping, crawler, data-labeling, annotation-tool, synthetic-data
464 results
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
A simple web scraper to extract Product Data and Pricing from Amazon
Learn everything web scraping with David Teather Codes on YouTube
A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
ACHE is a web crawler for domain-specific search.
Execute complex automation scripts via remote cloud sessions , featuring integrated residential proxies , automated CAPTCHA solving , and native JavaScript rendering for the toughest dynamic websites.
A framework for creating semi-automatic web content extractors
Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.
🎯 哔哩哔哩(bilibili)评论区数据可视化分析软件-- up主可用于指导自己的题材选择，明确自己的粉丝群体
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Undetected web-scraping & seamless HTML parsing in Python!
Fetch user's data across social media
A universal web-util for PHP.
100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.
Guide to Using Google Sheets for Basic Web Scraping
Nextjs server to query websites with GraphQL
🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
Random User-Agent middleware based on fake-useragent
Undetected NodeJS version of the Playwright testing and automation library.
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
Google Search Results via SERP API pip Python Package
Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
24,545 repositories in the index in total.
