Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
A very simple news crawler with a funny name
| Date | Stars |
|---|---|
| 2026-07-24 | 468 |
| 2026-07-25 | 468 |
| 2026-07-28 | 470 |
| 2026-07-30 | 471 |
| 2026-08-06 | 472 |
| 2026-08-15 | 472 |
| 2026-08-18 | 473 |
| 2026-09-02 | 474 |
| 2026-09-16 | 475 |
| 2026-09-17 | 476 |
| 2026-09-20 | 476 |
Today
— stars today
This week
+2 stars this week
This month
+3 stars this month
Momentum
17.0
growth rate 0.42%/day
<p align="center">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="https://github.com/flairNLP/fundus/blob/master/resources/logo/svg/logo_darkmode_with_font_and_clear_space.svg">
<source media="(prefers-color-scheme: light)" srcset="https://github.com/flairNLP/fundus/blob/master/resources/logo/svg/logo_lightmode_with_font_and_clear_space.svg">
<img src="https://github.com/flairNLP/fundus/blob/master/resources/logo/svg/logo_lightmode_with_font_and_clear_space.svg" alt="Logo" width="50%" height="50%">
</picture>
</p>
<p align="center">A very simple <b>news crawler</b> in Python.
Developed at <a href="https://www.informatik.hu-berlin.de/en/forschung-en/gebiete/ml-en/">Humboldt University of Berlin</a>.
</p>
<p align="center">
<a href="https://pypi.org/project/fundus/"><img alt="PyPi version" src="https://badge.fury.io/py/fundus.svg"></a>
<img alt="python" src="https://img.shields.io/badge/python-3.8-blue">
<img alt="Static Badge" src="https://img.shields.io/badge/license-MIT-green">
<img alt="Publisher Coverage" src="https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/dobbersc/ca0ae056b05cbfeaf30fa42f84ddf458/raw/fundus_publisher_coverage.json">
</p>
<div align="center">
<hr>
[Quick Start](#quick-start) | [Tutorials](#tutorials) | [News Sources](/docs/supported_publishers.md) | [Paper](https://aclanthology.org/2024.acl-demos.29/)
</div>
---
***Disclaimer**: Although we try to provide an indication of whether a publisher has not explicitly objected to the training of AI models on its data, we would like to point out that this information must be verified independently before their content is used.
More details can be found [here](docs/5_advanced_topics.md#filtering-publishers-for-ai-training).*
---
Fundus is:
* **A static news crawler.**
Fundus lets you crawl online news articles with only a few lines of Python code!
Be it from live websites or the CC-NEWS dataset.
* **An open-source Python package.**
Fundus is built on the idea of building something together.
We welcome your contribution to help Fundus [grow](docs/how_to_contribute.md)!
<hr>
## Quick Start
To install from pip, simply do:
```
pip install fundus
```
Fundus requires Python 3.8+.
## Example 1: Crawl a bunch of English-language news articles
Let's use Fundus to crawl 2 articles from publishers based in the US.
```python
from fundus import PublisherCollection, Crawler
# initialize the crawler for news publishers based in the US
crawler = Crawler(PublisherCollection.us)
# crawl 2 articles and print
for article in crawler.crawl(max_articles=2):
print(article)
```
That's already it!
If you run this code, it should print out something like this:
```console
Fundus-Article including 1 image(s):
- Title: "Feinstein's Return Not Enough for Confirmation of Controversial New [...]"
- Text: "89-year-old California senator arrived hour late to Judiciary Committee hearing
to advance President Biden's stalled nominations Democrats [...]"
- URL: https://freebeacon.com/politics/feinsteins-return-not-enough-for-confirmation-of-controversial-new-hampshire-judicial-nominee/
- From: The Washington Free Beacon (2023-05-11 18:41)
Fundus-Article including 3 image(s):
- Title: "Northwestern student government freezes College Republicans funding over [...]"
- Text: "Student government at Northwestern University in Illinois "indefinitely" froze
the funds of the university's chapter of College Republicans [...]"
- URL: https://www.foxnews.com/us/northwestern-student-government-freezes-college-republicans-funding-poster-critical-lgbtq-community
- From: Fox News (2023-05-09 14:37)
```
This printout tells you that you successfully crawled two articles!
For each article, the printout details:
- the number of images included in the article
- the "Title" of the article, i.e. its headline
- the "Text", i.e. the main article body text
- the "URL" from which it was crawled
- the nExcerpt of 13,877 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:d64c72820424d877, topic:datasets, topic:corpus, readme:dataset
matched fp:d64c72820424d877, topic:web-scraping, topic:crawler
matched fp:d64c72820424d877, topic:image-classification
matched fp:d64c72820424d877, topic:nlp