Tim Hey

What agents read

Every machine-readable file this site serves, in one place. Click any of them. This is exactly what an agent sees when it visits.

curl timhey.co/.well-known/

GET /llms.txt
site map for models
GET /.well-known/ai-catalog.json
ARD capability catalog
GET /feed.xml
writing feed (RSS)
GET /robots.txt
crawl + AI-bot rules
GET /sitemap.xml
every URL, dated
GET /posts/the-files-agents-look-for.md
markdown mirror, one per post

Every post ships two more an agent can use: the Markdown mirror above, and JSON-LD in the page head. View source on any post to read the typed facts an agent lifts instead of guessing.

New to this? Start with the files an agent checks before it reads your page.

Who’s crawling this, live

This site logs its own agent readers. Crawlers and agents don’t run JavaScript, so analytics never sees them — these counts come from the middleware, before the cache. It’s the argument these posts make, measuring itself.

95 agent visits from 12 distinct agents.

By agent

  • Anthropic ClaudeBot31
  • unknown18
  • OpenAI GPTBot18
  • Googlebot9
  • Amazon5
  • OpenAI SearchBot4
  • Bingbot3
  • Applebot2
  • Meta2
  • Anthropic Claude-User1
  • Perplexity1
  • ByteDance1

Most requested paths

  • /robots.txt30
  • /sitemap.xml14
  • /6
  • /llms.txt5
  • /agents5
  • /posts/the-files-agents-look-for4
  • /posts/what-an-agent-reads.md4
  • /posts/the-files-agents-look-for.md4

Volume

Jun 20last 14 daysJul 3

Recent hits

  • Anthropic ClaudeBot/agents07-03 17:54
  • Anthropic ClaudeBot/robots.txt07-03 17:54
  • OpenAI SearchBot/robots.txt07-03 17:32
  • Anthropic ClaudeBot/07-03 16:40
  • Anthropic ClaudeBot/sitemap.xml07-03 16:29
  • Anthropic ClaudeBot/robots.txt07-03 16:29
  • Amazon/agents07-03 16:15
  • Amazon/posts/the-files-agents-look-for07-03 15:32
  • Bingbot/sitemap.xml07-03 14:57
  • Bingbot/robots.txt07-03 14:57
  • Anthropic ClaudeBot/sitemap.xml07-03 14:39
  • Anthropic ClaudeBot/robots.txt07-03 14:39

Raw JSON: /api/agent-traffic