Scrape-LE

Developer Tools npm v2.6.0

Analyse robots.txt content and report whether a path may be crawled.

View source ↗ Website ↗ Generate config for multiple servers More servers

Install

Pin version registry version 2.6.0

npm
npx -y scrape-le-mcp

npm
npx -y scrape-le-mcp@2.6.0

Setup by client

Pick your client — the config below is generated for this server (local stdio). Copy respects the “Pin version” switch above.

claude_desktop_config.json

{
  "mcpServers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}

{
  "mcpServers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp@2.6.0"
      ]
    }
  }
}

Format verified against the official Claude Desktop docs ↗.

terminal

claude mcp add scrape-le -- npx -y scrape-le-mcp

claude mcp add scrape-le -- npx -y scrape-le-mcp@2.6.0

Format verified against the official Claude Code docs ↗.

.cursor/mcp.json

{
  "mcpServers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}

{
  "mcpServers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp@2.6.0"
      ]
    }
  }
}

Format verified against the official Cursor docs ↗.

.vscode/mcp.json

{
  "servers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}

{
  "servers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp@2.6.0"
      ]
    }
  }
}

Format verified against the official VS Code docs ↗.

mcp_config.json

{
  "mcpServers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}

{
  "mcpServers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp@2.6.0"
      ]
    }
  }
}

Format verified against the official Windsurf docs ↗.

GitHub

⭐ 1 stars · 最近更新于 30 天前 · MIT license

About this server

/ Scrape LE: Zero Hassle Scrapeability Checks Load a URL in headless Chromium and see what will block your scraper — before you write it / Anti…

Summary from the project README — github.com/nolindnaidoo/scrape-le

Distributed as npm, listed under Developer Tools. Review our MCP security guide before granting access to real data.

Frequently asked questions

What does the Scrape-LE MCP server do?

/ Scrape LE: Zero Hassle Scrapeability Checks Load a URL in headless Chromium and see what will block your scraper — before you write it / Anti

How do I install Scrape-LE?

Run the install command shown above, then paste the config for your client (Claude Desktop, Claude Code, Cursor, VS Code or Windsurf) into its MCP settings and restart the client.

Is Scrape-LE free to use?

The MCP server itself is free to install. The source is public on https://github.com/nolindnaidoo/scrape-le. Any third-party service it calls may require its own API key and account.

Which clients support Scrape-LE?

Any MCP-compatible client can use it, including Claude Desktop, Claude Code, Cursor, VS Code, Windsurf and custom agents.

Add this badge

Publish this server? Link back with a badge on your README or site — copy either snippet.

Markdown

[![Listed on MCPNav](https://mcpnav.net/badge/scrape-le.svg)](https://mcpnav.net/server/scrape-le/)

HTML

<a href="https://mcpnav.net/server/scrape-le/"><img src="https://mcpnav.net/badge/scrape-le.svg" alt="Listed on MCPNav" height="20"></a>