Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, and multi-strategy article extraction
| Date | Stars |
|---|---|
| 2026-07-24 | 301 |
| 2026-07-25 | 301 |
| 2026-07-28 | 301 |
| 2026-07-30 | 301 |
| 2026-08-06 | 301 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# agent-fetch [](https://www.npmjs.com/package/@teng-lin/agent-fetch) [](https://www.npmjs.com/package/@teng-lin/agent-fetch) [](https://opensource.org/licenses/MIT) [](https://github.com/teng-lin/agent-fetch/actions/workflows/ci.yml) **Full-content web fetcher for AI agents and content workflows.** Standard HTTP tools (curl, wget, or an agent's built-in web fetch) are often served truncated or different responses because servers inspect the client's network fingerprint. agent-fetch uses [browser impersonation](https://github.com/sardanioss/httpcloak) so servers respond as they would to a real browser, then runs multiple extraction strategies to pull the complete article — every paragraph, heading, and link. Also supports multi-page crawling, persistent cookies, and custom CSS selectors. Runs locally with no API keys or cloud dependencies. Also useful for: - **NotebookLM** can't add a URL as a source — extract the content and paste it as text - **RAG pipelines** need clean markdown from web pages, not HTML soup or truncated summaries - **LLM conversations** where you need the full article in context, not a 3-paragraph summary | | Built-in agent fetch | Cloud extraction APIs | agent-fetch | | ------------------------- | --------------------- | --------------------- | ---------------------------------------------------------------------------------- | | **Content** | Summary or truncation | Full (usually) | Full article text | | **Structure** | Plain text blob | Markdown (varies) | Markdown with headings, links, lists | | **Runs locally** | Yes | No | Yes | | **API key required** | No | Yes | No | | **Extraction strategies** | 1 (basic parse) | 1–2 | Multiple (Readability, JSON-LD, Next.js, RSC, WP API, text-density, CSS selectors) | | **Open source** | N/A | Partial | Yes | ## Install ```bash npm install @teng-lin/agent-fetch ``` Or run without installing: ```bash npx agent-fetch https://example.com/page ``` ### AI Agents (Claude Code, Codex, Cursor, Copilot) Install the [Agent Skill](https://agentskills.io) and your agent will automatically use agent-fetch when it needs to read URLs: ```bash npx skills add teng-lin/agent-fetch ``` The skill teaches agents when and how to call agent-fetch — no configuration needed. ## Quick Start ### CLI ```bash # Extract article as markdown npx agent-fetch https://example.com/article # Markdown content only (no metadata header) npx agent-fetch https://example.com/article -q # Full JSON output (title, content, markdown, metadata) npx agent-fetch https://example.com/article --json # Plain text only npx agent-fetch https://example.com/article --text # Raw HTML (no extraction) npx agent-fetch https://example.com/article --raw # Custom timeout (default: 20s) npx agent-fetch https://example.com/article --timeout 30000 # With cookies (inline) npx agent-fetch https://example.com/article --cookie "sessionId=abc123; theme=dark" # With cookies (Netscape cookie file) npx agent-fetch https://example.com/article --cookie-file ~/.cookies.txt ``` **Getting
Excerpt of 8,894 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:f2b127a74c0ddc46, topic:ai-agents, desc:ai agents, readme:ai agents
matched fp:f2b127a74c0ddc46, topic:web-scraping