Skip to content

site_tools

Can AI reach the site? robots.txt.

ScanFree's free tools, no AI. tool reach: "Can AI reach you?" (robots.txt, the home page, the sitemap and a few key pages as AI crawlers see them); it queues and returns run_id, then call again with run_id for the lines (a few runs a day). tool robots: which AI crawlers robots.txt lets in, on the home page and key paths, with the lines that decided each; answers at once. Give url, or site_id for one of your sites.

Who can use it

Access
Any account. No AI is used.
Scope
scan:read
Changes anything
No. Read-only.

Inputs

NameTypeRequiredValues and limits
toolstringYesreach, robots
urlstringNo
site_idstringNo
run_idstringNoFor reach: the run_id from the first call

What it answers

Every answer has status and, where useful, message in plain words.

FieldMeaning
reach, first callstatus queued and run_id. Call again with the run_id in about a minute.
reach, with run_idpages_read, started_at, finished_at and lines: key, group, label, status, evidence and fix.
robotsWhich AI crawlers robots.txt lets in, on the home page and key paths, with the lines that decided each. Answers at once.

Errors

statusWhat it means
invalid_inputNo url or site_id, the address is refused, or tool isn't reach or robots.
invalid_inputsite_id isn't a site id. Take one from sites (action list) or get_dashboard.
not_foundNo site with that id on this account.
not_foundNo such run on this account.
limitedThe daily reach runs, or the robots checker's 30 an hour, are used up.
not_availableThe robots checker isn't available on this server.
forbiddenThe credential lacks the tool's scope, or an agent's owner has no ScanFree account yet (the owner signs in on the website once).
Input validation errorAn argument doesn't match the schema below. The call fails with MCP error -32602, naming the field.

Errors before the tool runs (a missing key, too many requests) are on the MCP page.

Example

Example shape; values are illustrative.

The call
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "site_tools",
    "arguments": {
      "tool": "reach",
      "url": "example.com"
    }
  }
}
The answer (structured content)
{
  "status": "queued",
  "tool": "reach",
  "run_id": "00000000-0000-4000-8000-000000000007",
  "url": "https://example.com/",
  "message": "\"Can AI reach you?\" is running … Call site_tools again with tool reach and this run_id in about a minute."
}