AI Crawler Index
Identify AI crawlers by user-agent or IP, verify them against operator ranges, build robots.txt.
endpoint: https://www.pathwren.workers.dev/c/mcp-registry-official/mcp
registry: dev.workers.pathwren.www/ai-crawler-index
B
recent success 100% (30 probes) ·
MCP handshake OK
· protocol 2025-06-18
TLS valid (47d left) · latency 1624.0 ms ·
HTTP 200 · auth open ·
tools 9
manifest 2a6946175f90134b
· drift events seen here: 2
Heuristic flags
- visit-url-instruction — tool instructs the agent to fetch an external URL
Flags are pattern matches on public tool descriptions, not verdicts. Read them as questions to ask the vendor.
Embed this grade
<a href="https://golemreach.com/trust/s/14722"> <img src="https://golemreach.com/trust/badge/14722.svg" alt="golemreach trust grade"></a>
Recent probes
| time (UTC) | ok | grade | mcp | latency | tls | tools | hash |
|---|---|---|---|---|---|---|---|
| 2026-10-13T04:54:06Z | ✓ | B | ✓ | 1624.0 ms | 47d | 9 | 2a6946175f90134b |
| 2026-10-12T22:53:14Z | ✓ | C | ✓ | 7776.0 ms | 47d | 9 | 2a6946175f90134b |
| 2026-10-12T16:51:17Z | ✓ | B | ✓ | 53.0 ms | 48d | 9 | 2a6946175f90134b |
| 2026-10-12T10:47:26Z | ✓ | B | ✓ | 51.0 ms | 48d | 9 | 2a6946175f90134b |
| 2026-10-12T04:40:36Z | ✓ | B | ✓ | 62.0 ms | 48d | 9 | 2a6946175f90134b |
| 2026-10-11T22:39:49Z | ✓ | B | ✓ | 109.0 ms | 48d | 9 | 2a6946175f90134b |
| 2026-10-11T16:39:15Z | ✓ | B | ✓ | 60.0 ms | 49d | 9 | 2a6946175f90134b |
| 2026-10-11T10:38:00Z | ✓ | B | ✓ | 52.0 ms | 49d | 9 | 2a6946175f90134b |
| 2026-10-11T04:37:04Z | ✓ | B | ✓ | 75.0 ms | 49d | 9 | 2a6946175f90134b |
| 2026-10-10T22:36:12Z | ✓ | B | ✓ | 34.0 ms | 49d | 9 | 2a6946175f90134b |
| 2026-10-10T16:35:21Z | ✓ | B | ✓ | 71.0 ms | 50d | 9 | 2a6946175f90134b |
| 2026-10-10T10:34:33Z | ✓ | B | ✓ | 37.0 ms | 50d | 9 | 2a6946175f90134b |
| 2026-10-10T04:34:06Z | ✓ | B | ✓ | 66.0 ms | 50d | 9 | 2a6946175f90134b |
| 2026-10-09T22:32:05Z | ✓ | B | ✓ | 58.0 ms | 50d | 9 | 2a6946175f90134b |
| 2026-10-09T16:30:32Z | ✓ | B | ✓ | 73.0 ms | 51d | 9 | 2a6946175f90134b |
| 2026-10-09T10:28:18Z | ✓ | B | ✓ | 52.0 ms | 51d | 9 | 2a6946175f90134b |
| 2026-10-09T04:26:13Z | ✓ | B | ✓ | 81.0 ms | 51d | 9 | 2a6946175f90134b |
| 2026-10-08T22:25:15Z | ✓ | B | ✓ | 217.0 ms | 51d | 9 | 2a6946175f90134b |
| 2026-10-08T16:24:32Z | ✓ | B | ✓ | 48.0 ms | 52d | 9 | 2a6946175f90134b |
| 2026-10-08T10:23:12Z | ✓ | B | ✓ | 65.0 ms | 52d | 9 | 2a6946175f90134b |
| 2026-10-08T04:22:44Z | ✓ | B | ✓ | 58.0 ms | 52d | 9 | 2a6946175f90134b |
| 2026-10-07T22:21:51Z | ✓ | B | ✓ | 55.0 ms | 52d | 9 | 2a6946175f90134b |
| 2026-10-07T16:20:45Z | ✓ | B | ✓ | 63.0 ms | 53d | 9 | 2a6946175f90134b |
| 2026-10-07T10:19:34Z | ✓ | B | ✓ | 47.0 ms | 53d | 9 | 2a6946175f90134b |
| 2026-10-07T04:19:25Z | ✓ | B | ✓ | 82.0 ms | 53d | 9 | 2a6946175f90134b |
| 2026-10-06T22:17:39Z | ✓ | B | ✓ | 39.0 ms | 53d | 9 | 2a6946175f90134b |
| 2026-10-06T16:16:47Z | ✓ | B | ✓ | 92.0 ms | 54d | 9 | 2a6946175f90134b |
| 2026-10-06T10:15:52Z | ✓ | B | ✓ | 45.0 ms | 54d | 9 | 2a6946175f90134b |
| 2026-10-06T04:15:06Z | ✓ | B | ✓ | 119.0 ms | 54d | 9 | 2a6946175f90134b |
| 2026-10-05T22:13:45Z | ✓ | B | ✓ | 53.0 ms | 54d | 9 | 2a6946175f90134b |