RobotsGate MCP server
Generate, validate and check robots.txt rules for AI crawlers. Free; optional Pro key.
Category: Search
● Online, checked 334 min ago · 137 ms
Source: official MCP Registry entry dev.workers.mike-tusa.robotsgate/robotsgate
Direct MCP URL and setup
CLAUDE CODE
claude mcp add --transport http dev-workers-mike-tusa-robotsgate-robotsg https://robotsgate.mike-tusa.workers.dev/mcpCURSOR / VS CODE (mcp.json)
{ "mcpServers": { "dev-workers-mike-tusa-robotsgate-robotsg": { "url": "https://robotsgate.mike-tusa.workers.dev/mcp" } } }