For AI agents

The same items and the same words a person sees: a JSON answer for each list, a Markdown copy of each page.

Every page is also data

An AI agent reads the same items and the same words as a person, as files it can fetch without a browser:

  • Every item Explore lists, as JSON: /explore.json, each item with its type, title, summary and page.
  • Every list as JSON, beside its page: /stories.json, /apps.json and each other list, with its filters and every row.
  • Every page as Markdown, beside its page: add .md to its address, as in /stories.md; the home page is /index.md.
  • The map of it all: /llms.txt names the pages and the files above, /llms-full.txt holds every page's words in one file, and /sitemap.xml lists every page.

Every page is public: nothing here needs a sign-in.

Who may read it

OAI-SearchBot
OpenAI · reads pages to answer a person's question
ChatGPT-User
OpenAI · reads pages to answer a person's question
GPTBot
OpenAI · collects pages to train AI models
Claude-SearchBot
Anthropic · reads pages to answer a person's question
Claude-User
Anthropic · reads pages to answer a person's question
ClaudeBot
Anthropic · collects pages to train AI models
PerplexityBot
Perplexity · reads pages to answer a person's question
Perplexity-User
Perplexity · reads pages to answer a person's question
Google-Extended
Google · collects pages to train AI models
Applebot-Extended
Apple · collects pages to train AI models
CCBot
Common Crawl · collects pages to train AI models
Meta-ExternalAgent
Meta · collects pages to train AI models
Bytespider
ByteDance · collects pages to train AI models