Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
🔥 Generate llms.txt and llms-full.txt files for any website!
| Date | Stars |
|---|---|
| 2026-07-31 | 534 |
| 2026-08-06 | 537 |
| 2026-08-19 | 537 |
| 2026-09-01 | 538 |
| 2026-09-03 | 538 |
| 2026-09-04 | 539 |
| 2026-09-07 | 538 |
| 2026-09-13 | 537 |
| 2026-09-14 | 536 |
| 2026-09-17 | 537 |
| 2026-09-20 | 537 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# ⚠️ DEPRECATION NOTICE This API is being deprecated in favor of our main endpoints. Here is an example repo that generates LLMs.txt files: https://github.com/mendableai/create-llmstxt-py. This API endpoint will still remain active but we will no longer be maintaining it after June 30, 2025. # llms.txt Generator 🚀 Generate consolidated text files from websites for LLM training and inference. Powered by [@firecrawl_dev](https://twitter.com/firecrawl_dev) for web crawling and GPT-4-mini for text processing. ## Features - Crawls websites and combines content into a single text file - Generates both standard (`llms.txt`) and full (`llms-full.txt`) versions - Web interface and API access available - No API key required for basic usage ## Usage ### Web Interface Visit [llmstxt.firecrawl.dev](https://llmstxt.firecrawl.dev) to generate files through the browser. ### API Endpoint ``` GET https://llmstxt.firecrawl.dev/[YOUR_URL_HERE] ``` Note: Processing may take several minutes due to crawling and LLM operations. ## Local Development ### Prerequisites Create a `.env` file with the following variables: ``` FIRECRAWL_API_KEY= SUPABASE_URL= SUPABASE_KEY= OPENAI_API_KEY= ``` ### Installation ```bash npm install npm run dev ```
Excerpt of 1,246 characters
Read on GitHub
Nicolas · Firecrawl · United States
4
Eric Ciarla · Firecrawl
3
3
Rafael Miller
1
Ademílson Tonato · Portugal
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:577021a58b3386dd, llm:Repository description: "Generate llms.txt and llms-full.txt files for any website!" (firecrawl/llmstxt-generator). No topics provided.