For AI agents
The same items and the same words a person sees: a JSON answer for each list, a Markdown copy of each page.
Every page is also data
An AI agent reads the same items and the same words as a person, as files it can fetch without a browser:
- Every item Explore lists, as JSON:
/explore.json, each item with its type, title, summary and page. - Every list as JSON, beside its page:
/stories.json,/apps.jsonand each other list, with its filters and every row. - Every page as Markdown, beside its page: add
.mdto its address, as in/stories.md; the home page is/index.md. - The map of it all:
/llms.txtnames the pages and the files above,/llms-full.txtholds every page's words in one file, and/sitemap.xmllists every page.
Every page is public: nothing here needs a sign-in.
Who may read it
- OAI-SearchBot
- OpenAI · reads pages to answer a person's question
- ChatGPT-User
- OpenAI · reads pages to answer a person's question
- GPTBot
- OpenAI · collects pages to train AI models
- Claude-SearchBot
- Anthropic · reads pages to answer a person's question
- Claude-User
- Anthropic · reads pages to answer a person's question
- ClaudeBot
- Anthropic · collects pages to train AI models
- PerplexityBot
- Perplexity · reads pages to answer a person's question
- Perplexity-User
- Perplexity · reads pages to answer a person's question
- Google-Extended
- Google · collects pages to train AI models
- Applebot-Extended
- Apple · collects pages to train AI models
- CCBot
- Common Crawl · collects pages to train AI models
- Meta-ExternalAgent
- Meta · collects pages to train AI models
- Bytespider
- ByteDance · collects pages to train AI models