Tim Hey

What agents read

Every machine-readable file this site serves, in one place. Click any of them. This is exactly what an agent sees when it visits.

curl timhey.co/.well-known/

GET /llms.txt
site map for models
GET /.well-known/ai-catalog.json
ARD capability catalog
GET /feed.xml
writing feed (RSS)
GET /robots.txt
crawl + AI-bot rules
GET /sitemap.xml
every URL, dated
GET /posts/the-registry-is-the-search-index.md
markdown mirror, one per post

Every post ships two more an agent can use: the Markdown mirror above, and JSON-LD in the page head. View source on any post to read the typed facts an agent lifts instead of guessing.

New to this? Start with the files an agent checks before it reads your page.

Who’s crawling this, live

This site logs its own agent readers. Crawlers and agents don’t run JavaScript, so analytics never sees them — these counts come from the middleware, before the cache. It’s the argument these posts make, measuring itself.

1,990 agent visits from 20 distinct agents.

By agent

  • ByteDance520
  • Anthropic ClaudeBot507
  • unknown282
  • Googlebot120
  • OpenAI SearchBot102
  • Amazon99
  • Bingbot95
  • Meta75
  • OpenAI GPTBot59
  • Applebot28
  • Common Crawl22
  • OpenAI ChatGPT-User19
  • Perplexity16
  • Anthropic Claude-User13
  • Diffbot9
  • Applebot-Extended7
  • Cohere6
  • Perplexity-User5
  • Anthropic4
  • DuckDuckGo2

Most requested paths

  • /robots.txt512
  • /sitemap.xml268
  • /170
  • /agents109
  • /resume95
  • /posts/the-files-agents-look-for57
  • /feed.xml56
  • /llms.txt47

Volume

Jul 9last 14 daysJul 22

Recent hits

  • Common Crawl/agents07-22 01:03
  • Common Crawl/posts/the-trust-gap07-22 00:56
  • Common Crawl/robots.txt07-22 00:56
  • Bingbot/posts/github-agent-traffic07-22 00:06
  • unknown/posts/two-disciplines.md07-21 23:17
  • unknown/posts/which-agent-files-you-need.md07-21 23:17
  • Anthropic ClaudeBot/sitemap.xml07-21 22:11
  • Anthropic ClaudeBot/robots.txt07-21 22:11
  • unknown/posts/the-trust-gap.md07-21 22:04
  • Bingbot/posts/the-files-agents-look-for.md07-21 20:57
  • Bingbot/robots.txt07-21 20:57
  • Anthropic ClaudeBot/07-21 20:32

Raw JSON: /api/agent-traffic