# Access for automated clients

## Authentication
None required. Every page and every endpoint listed in [llms.txt](https://theinternetcompass.com/llms.txt)
is public and unauthenticated. Do not attempt to discover or guess credentials —
there are none to find; nothing on this site is gated behind a login.

## Rate limits
No hard rate limit is enforced today. Be a reasonable citizen: back off on
repeated errors, cache responses where the content is not time-sensitive, and
avoid re-crawling the full site more than once per day (see `sitemap.xml`
`lastmod` values to fetch only what changed).

## Endpoints
| Endpoint | Format | Notes |
|---|---|---|
| `/sitemap.xml` | XML | Full URL index with lastmod |
| `/robots.txt` | text | Crawl rules, AI crawlers explicitly allowed |
| `/llms.txt` | Markdown | Curated site index |
| `/llms-full.txt` | Markdown | Expanded index with inlined content |
| `/api/snapshot` | JSON | Live dataset statistics |
| `/api/catalog` | JSON | Available endpoints and shapes |
| `/api/mcp` | JSON | MCP server descriptor |
| `/catalog.md` | Markdown | Every indexable URL |
| `/search-index.json` | JSON | Flat search index (title, href, type, summary) |

## Contact
Questions about automated access: editorial@theinternetcompass.com