The Most Powerful Open-source LLM Friendly Typescript Web Crawler & Scraper
-
Updated
Mar 5, 2026 - TypeScript
The Most Powerful Open-source LLM Friendly Typescript Web Crawler & Scraper
Fast Python web crawler for RAG and AI ingestion. Extracts clean Markdown from any site for LLMs and vector stores.
Self-hosted web search & fetch API in Go that speaks DeepSeek's /v1/tools protocol — aggregate Bing, SearXNG, Brave & Tavily behind one base_url.
rag web browser automation tool
Docs and examples for the JS Content Crawler Lite for RAG actor on Apify
crawl4ai website content extractor
web crawler metadata extraction
To associate your repository with the markdown-extraction topic, visit your repo's landing page and select "manage topics."