What is smart-crawler?

smart-crawler is an MCP (Model Context Protocol) server by shulex-voc in the Web Scraping category. E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

How do I connect smart-crawler to Claude, Cursor, or another MCP client?

smart-crawler is a remote MCP server — add its endpoint (https://smartcrawler.io/mcp/) to your client's MCP configuration (for example with "claude mcp add", or under "mcpServers" in Cursor's mcp.json) and restart the client.

Is smart-crawler open source?

Yes — the source code is public at github.com/shulex-voc/smart-crawler.

Can AI agents pay to use smart-crawler?

Not yet through Loomal — smart-crawler is listed as a free directory entry. If its maintainer verifies ownership, they can set per-call USDC pricing that agents pay over x402, with settlement on Base.

smart-crawler

MCP server by github.com/shulex-voc/smart-crawler

E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

0 starsRemote-capable

About smart-crawler

smart-crawler is an MCP (Model Context Protocol) server published by shulex-voc in the official MCP registry, listed under Web Scraping on Loomal. E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

smart-crawler runs as a hosted remote over streamable-http — MCP clients connect directly to its endpoint, with nothing to install locally.

Development happens in the open at github.com/shulex-voc/smart-crawler.

Use smart-crawler with your agent

Claude Code · one command

claude mcp add --transport http smart-crawler https://smartcrawler.io/mcp/ --header "Authorization: Bearer {api_key}"

Claude Desktop, Cursor & other MCP clients · config

{
  "mcpServers": {
    "smart-crawler": {
      "url": "https://smartcrawler.io/mcp/",
      "headers": {
        "Authorization": "Bearer {api_key}"
      }
    }
  }
}

streamable-httphttps://smartcrawler.io/mcp/

Frequently asked questions

What is smart-crawler?: smart-crawler is an MCP (Model Context Protocol) server by shulex-voc in the Web Scraping category. E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.
How do I connect smart-crawler to Claude, Cursor, or another MCP client?: smart-crawler is a remote MCP server — add its endpoint (https://smartcrawler.io/mcp/) to your client's MCP configuration (for example with "claude mcp add", or under "mcpServers" in Cursor's mcp.json) and restart the client.
Is smart-crawler open source?: Yes — the source code is public at github.com/shulex-voc/smart-crawler.
Can AI agents pay to use smart-crawler?: Not yet through Loomal — smart-crawler is listed as a free directory entry. If its maintainer verifies ownership, they can set per-call USDC pricing that agents pay over x402, with settlement on Base.

More Web Scraping MCP servers

Firecrawl MCP Server

6.5k

MCP server for Firecrawl — search, scrape, and interact with the web.

webclaw

1.3k

Web extraction MCP server. Scrape, crawl, extract, summarize any URL to clean markdown.

CRW Web Scraper

164

Open-source web scraper for AI agents with scrape, crawl, and map tools

one-search-mcp

118

Web search, crawl, scrape & extract with agent-browser, SearXNG, Tavily, DuckDuckGo, Bing & more

scrapegraph-mcp

AI-powered web scraping and data extraction capabilities through ScrapeGraph API

ShadowCrawl

Rust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.

Browse the full MCP server directory

Listing data from the official MCP registry and GitHub, refreshed periodically. Not affiliated with the maintainer unless claimed. Maintain smart-crawler? Claim this listing free by verifying GitHub ownership, or contact us.