The archive
Every deep dive, newest first. Filter by topic, or browse everything.
4 posts
llms.txt is a newer, third idea: a short, human-written map of your best content, in Markdown, addressed to language models rather than search engines. It is worth understanding — and worth being honest about, because the evidence on whether anything actually reads it is mixed. We will cover both.
Before Google, Bing, or ChatGPT's crawler reads a single page of your site. What it finds there decides where it goes next. It is the smallest, oldest, and most misunderstood file in web publishing — and one of the few where a single wrong line can quietly cost you all your search traffic.
A sitemap is a machine-readable list of every URL you want indexed, plus a hint about when each one last changed. That last part is what makes it valuable: without it, a crawler has to guess whether your pages are worth re-checking.
Claude forgets everything when you close the terminal or when the context gets compacted. This script fixes that: it saves your working state to files on disk, and loads them back automatically next time.
