ShadowCrawl
MCP server by github.com/devshero/shadowcrawl
Rust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.
About ShadowCrawl
ShadowCrawl is an MCP (Model Context Protocol) server published by devshero in the official MCP registry, listed under Web Scraping on Loomal. Rust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.
Development happens in the open at github.com/devshero/shadowcrawl, where the project has earned 66 GitHub stars.
Frequently asked questions
- What is ShadowCrawl?
- ShadowCrawl is an MCP (Model Context Protocol) server by devshero in the Web Scraping category. Rust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.
- How do I connect ShadowCrawl to Claude, Cursor, or another MCP client?
- Build ShadowCrawl from source at github.com/devshero/shadowcrawl and register it under "mcpServers" in your client's MCP configuration, then restart the client.
- Is ShadowCrawl open source?
- Yes — the source code is public at github.com/devshero/shadowcrawl, with 66 GitHub stars.
- Can AI agents pay to use ShadowCrawl?
- Not yet through Loomal — ShadowCrawl is listed as a free directory entry. If its maintainer verifies ownership, they can set per-call USDC pricing that agents pay over x402, with settlement on Base.
More Web Scraping MCP servers
Firecrawl MCP Server
6.5k
MCP server for Firecrawl — search, scrape, and interact with the web.
webclaw
1.3k
Web extraction MCP server. Scrape, crawl, extract, summarize any URL to clean markdown.
CRW Web Scraper
164
Open-source web scraper for AI agents with scrape, crawl, and map tools
one-search-mcp
118
Web search, crawl, scrape & extract with agent-browser, SearXNG, Tavily, DuckDuckGo, Bing & more
scrapegraph-mcp
82
AI-powered web scraping and data extraction capabilities through ScrapeGraph API
Screaming Frog SEO Spider MCP Server
65
Crawl websites, export SEO data, and manage crawls via Screaming Frog SEO Spider.
Listing data from the official MCP registry and GitHub, refreshed periodically. Not affiliated with the maintainer unless claimed. Maintain ShadowCrawl? Claim this listing free by verifying GitHub ownership, or contact us.