Siddharth Saoji 
Bot traffic has already crossed human traffic on parts of the web. Cloudflare Radar has reports bot requests at roughly 57.5% of HTML traffic versus 42.5% from humans. The direction is clear, so I made some changes on sidd.blog to make it easier for AI agents to understand and use. If you run a blog or website this might be useful to note.
1. Added /llms.txt — The table of contents for AI
Like a library catalog card. An agent lands on your site and immediately knows what topics you cover, how many posts exist, and where to find each one — without crawling every page. I also added /llms-full.txt, which is the entire library in one book — instead of an agent opening 80+ individual pages one by one, it grabs a single file with every post’s full text. Like handing someone a compiled anthology instead of making them walk shelf to shelf.
2. Raw Markdown for every post — The clean transcript
A blog post’s HTML page has navigation, buttons, styles, scripts — noise for an agent. Append .md to any post URL and you get clean markdown. Like getting a typed transcript instead of a messy handwritten note with doodles in the margins. Every post also has a visible [MD] link next to the date.
3. JSON-LD structured data — The label on the jar
An agent sees your post and needs to figure out: who wrote this? when? what’s it about? JSON-LD is a machine-readable label stuck to every post — like nutritional info on food packaging. No guessing required. Each post includes schema.org/Article markup with headline, author, dates, and publisher info.
4. Open robots.txt + Sitemap — The welcome mat and floor plan
robots.txt says “come in, everything’s open.” The sitemap says “here’s every room in the house with its address.” Without these, agents either assume they’re not welcome or have to wander around hoping to find content.
If your site is hard to parse, you are harder to quote, harder to summarize, and easier to skip. This is not future-proofing. It is just making sure your content is readable in the world that already exists.