The Cost of a Slow Server

Crawl budget is quietly shaped by response time. When a host answers slowly, a well-behaved crawler backs off to avoid harm, and fewer pages get fetched per visit. Shaving a few hundred milliseconds off time-to-first-byte often does more for coverage than any meta tag.

← all notes