Google’s John Mueller in a hangout from earlier this week said that one of the myths he hears a lot is around crawling, specifically around how SEOs and webmasters define or understand crawl budget.

He said at the 8:34 mark into the video that “at Google we don’t really have this notion of crawl budget the way that people are talking about it externally.” He added that sometime before the end of the year, Google will come out with a blog post explaining crawl budget in more detail.

He goes on to explain most sites don’t need to worry about it. That only really large sites, that generate infinite number of pages, should consider how their servers can handle the load. But most sites do not need to even think about crawl budget.

Here is what he said:

It is funny because yes, we covered two recent questions that seemed obviously off, around crawl budget.

Although, Gary Illyes from Google went into more detail about how crawl budget works with Google.

Forum discussion at YouTube Live.