lorien/awesome-web-scraping
quality grade B, 66 out of 100List of libraries, tools and APIs for web scraping and data processing.
- stars
- 8.0k
- stars gained this week
- —this week
- forks, open issues and contributors
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
ETL, document parsing, web crawling, synthetic data generation, annotation and dataset curation tooling.
Signals: data-engineering, etl, data-pipeline, web-scraping, crawler, data-labeling, annotation-tool, synthetic-data
473 results
List of libraries, tools and APIs for web scraping and data processing.
A lightweight stream processing library for Go
Lightweight document management system packed with all the features you can expect from big expensive solutions
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
Ybat - YOLO BBox Annotation Tool
Synthetic data for computer vision. An open source toolkit using Blender and Python.
OCR system for Arabic language that converts images of typed text to machine-encoded text.
A collection of resources (including the papers and datasets) of OCR (Optical Character Recognition).
🎨 Ready-to-use DeepSeek-OCR Web UI | Modern Interface | 7 Recognition Modes | Batch Processing | Real-time Logging | Fully Responsive
Official code for our CVPR '22 paper "Dataset Distillation by Matching Training Trajectories"
Augmentation pipeline for rendering synthetic paper printing, faxing, scanning and copy machine processes
Scene Text Recognition with Permuted Autoregressive Sequence Models (ECCV 2022)
MixTeX multimodal LaTeX, ZhEn, and, Table OCR. It performs efficient CPU-based inference in a local offline on Windows.
Rust library and CLI tool for OCR (extracting text from images)
Convolutional Recurrent Neural Network (CRNN) for image-based sequence recognition.
Labeling tool with SAM(segment anything model),supports SAM, SAM2, SAM3, sam-hq, MobileSAM EdgeSAM etc.交互式半自动图像标注工具
Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022
24,523 repositories in the index in total.