Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
| Date | Stars |
|---|---|
| 2026-07-24 | 324 |
| 2026-07-25 | 324 |
| 2026-07-28 | 324 |
| 2026-07-30 | 324 |
| 2026-08-06 | 324 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# Scrapper <div markdown="1"> [](https://github.com/amerkurev/scrapper/actions/workflows/ci.yml) [](https://coveralls.io/github/amerkurev/scrapper?branch=master) [](https://hub.docker.com/r/amerkurev/scrapper) [](https://github.com/amerkurev/scrapper/blob/master/LICENSE) </div> Scrapper is a web scraper tool designed to download web pages and extract articles in a structured format. The application combines functionality from several open-source projects to provide an effective solution for web content extraction. ## Quick start Start a Scrapper instance with: ```console docker run -d -p 3000:3000 --name scrapper amerkurev/scrapper:latest ``` Scrapper will be available at http://localhost:3000/. For more details, see [Usage](#usage) ## Demo Watch a 30-second demo reel showcasing the web interface of Scrapper. https://user-images.githubusercontent.com/28217522/225941167-633576fa-c9e2-4c63-b1fd-879be2d137fa.mp4 ## Features Scrapper provides the following features: - **Built-in headless browser** - Integrates with [Playwright](https://github.com/microsoft/playwright) to handle JavaScript-heavy websites, cookie consent forms, and other interactive elements. - **Read mode parsing** - Uses Mozilla's [Readability.js](https://github.com/mozilla/readability) library to extract article content similar to browser "Reader View" functionality. - **Web interface** - Provides a user-friendly interface for debugging queries and experimenting with parameters. Built with the [Pico](https://github.com/picocss/pico) CSS framework with dark theme support. - **Simple REST API** - Features a straightforward API requiring minimal parameters for integration. - **News link extraction** - Identifies and extracts links to news articles from website main pages. Additional capabilities include: - **Result caching** - Caches parsing results to disk for faster retrieval. - **Page screenshots** - Captures visual representation of pages as seen by the parser. - **Session management** - Configurable incognito mode or persistent sessions. - **Proxy support** - Compatible with HTTP, SOCKS4, and SOCKS5 proxies. - **Customization options** - Control for HTTP headers, viewport settings, Readability parser parameters, and more. - **Docker delivery** - Packaged as a Docker image for simple deployment. - **Open-source license** - Available under MIT license. ## Usage ### Getting Scrapper The Scrapper Docker image includes Playwright and all necessary browser dependencies, resulting in an image size of approximately 2 GB. Ensure sufficient disk space is available, particularly if storing screenshots. To download the latest version: ```console docker pull amerkurev/scrapper:latest ``` ### Creating directories Scrapper requires two directories: 1. `user_data`: Stores browser session data and caches parsing results 2. `user_scripts`: Contains custom JavaScript scripts that can be injected into pages Scrapper runs under UID `1001` rather than root. Set appropriate permissions on mounted directories: ```console mkdir -p user_data user_scripts chown 1001:1001 user_data/ user_scripts/ ls -l ``` The output should show: ``` drwxr-xr-x 2 1001 1001 4096 Mar 17 23:23 user_data drwxr-xr-x 2 1001 1001 4096 Mar 17 23:23 user_scripts ``` > **Important note for macOS users** > > If you're running Scrapper on macOS, **do not** set ownership to UID 1001:1001 for the directories. Simply create the folders and Scrapper will work with your current user permissions: > > ```console > mkdir -p user_data user_scripts > ``` > > Setting `chown 1001:1001` on macOS will prevent Scrapper from writing to these directories! ### Managing Scrapper Cache The S
Excerpt of 21,527 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:08c4a01b048e593b, topic:web-scraping, topic:crawler