site_tools
Can AI reach the site? robots.txt.
ScanFree's free tools, no AI. tool reach: "Can AI reach you?" (robots.txt, the home page, the sitemap and a few key pages as AI crawlers see them); it queues and returns run_id, then call again with run_id for the lines (a few runs a day). tool robots: which AI crawlers robots.txt lets in, on the home page and key paths, with the lines that decided each; answers at once. Give url, or site_id for one of your sites.
Who can use it
- Access
- Any account. No AI is used.
- Scope
scan:read- Changes anything
- No. Read-only.
Inputs
| Name | Type | Required | Values and limits |
|---|---|---|---|
tool | string | Yes | reach, robots |
url | string | No | |
site_id | string | No | |
run_id | string | No | For reach: the run_id from the first call |
What it answers
Every answer has status and, where useful, message in plain words.
| Field | Meaning |
|---|---|
reach, first call | status queued and run_id. Call again with the run_id in about a minute. |
reach, with run_id | pages_read, started_at, finished_at and lines: key, group, label, status, evidence and fix. |
robots | Which AI crawlers robots.txt lets in, on the home page and key paths, with the lines that decided each. Answers at once. |
Errors
| status | What it means |
|---|---|
invalid_input | No url or site_id, the address is refused, or tool isn't reach or robots. |
invalid_input | site_id isn't a site id. Take one from sites (action list) or get_dashboard. |
not_found | No site with that id on this account. |
not_found | No such run on this account. |
limited | The daily reach runs, or the robots checker's 30 an hour, are used up. |
not_available | The robots checker isn't available on this server. |
forbidden | The credential lacks the tool's scope, or an agent's owner has no ScanFree account yet (the owner signs in on the website once). |
Input validation error | An argument doesn't match the schema below. The call fails with MCP error -32602, naming the field. |
Errors before the tool runs (a missing key, too many requests) are on the MCP page.
Example
Example shape; values are illustrative.
{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/call",
"params": {
"name": "site_tools",
"arguments": {
"tool": "reach",
"url": "example.com"
}
}
}{
"status": "queued",
"tool": "reach",
"run_id": "00000000-0000-4000-8000-000000000007",
"url": "https://example.com/",
"message": "\"Can AI reach you?\" is running … Call site_tools again with tool reach and this run_id in about a minute."
}