search & data extraction

Mcp Server Webcrawl

Advanced search and retrieval for web crawler data. Supports WARC, wget, Katana, SiteOne, and InterroBot crawlers.

python
local
search & data extraction
0
View on GitHub

Installation

npx -y pragmar/mcp-server-webcrawl

Configuration

Add this to your Copilot settings (Settings → Features → MCP → Add New MCP Server):

{
  "name": "mcp-server-webcrawl",
  "command": "npx",
  "args": [
    "-y",
    "pragmar/mcp-server-webcrawl"
  ]
}

About This MCP Server

pragmar/mcp-server-webcrawl

Advanced search and retrieval for web crawler data. Supports WARC, wget, Katana, SiteOne, and InterroBot crawlers.

GitHub: https://github.com/pragmar/mcp-server-webcrawl

Need More Details?

View the complete documentation, examples, changelog, and more on GitHub

View Full Documentation on GitHub