Top 5 This Week

Related Posts

Google Clarifies Use Of Noindex & 404 Status Codes For Crawl Budget Utilization

Google Gecko Crawl Budget

On Friday, Lizzi Sassman from Google updated the crawl budget management help document with two more topics. Specifically, Google added two new myths to the crawl budget documentation.

(1) Google added that using noindex isn’t a good way to control crawl budget but it can be a method to indirectly free up crawl budget in the long run, Google said.

(2) Also that pages that serve 4xx status codes (except 429) do not waste crawl budget, Google wrote.

Here is where Google added them, right at the bottom:

click for full size

Forum discussion at Mastodon.

Popular Articles