Sitemaps
XML sitemaps for search engines. Submit the index URL in Google Search Console for each property.
The full urlset (/sitemap.xml on www) is kept for app integrations.
Sitemaps are regenerated daily and served from cache when fresh.
/robots.txt lists index and news sitemap endpoints per locale.
Tag archives (/tag/…) are excluded and blocked in robots.
Author profile pages are included in the static sitemap part.