mirror of
https://github.com/audacity/audacity.github.io.git
synced 2026-04-13 15:35:01 -05:00
bb9dcd1797
Add robots.txt to block aggressive AI scrapers (GPTBot, Bytespider, SemrushBot, etc.) and set crawl delays for legitimate search engines. Add Cache-Control headers for HTML pages (1h TTL with stale-while-revalidate) so repeat visits are served from Netlify's CDN edge cache instead of origin. Defer below-fold video components from client:load to client:visible so their JS chunks only load when scrolled into view — bots and users who don't scroll never trigger those requests. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
