Machine-readable resources for crawlers and AI agents:
robots.txt
sitemap.xml
sitemap-md.xml
llms.txt