A fairly common question I see in the support forums is why is Google crawling my robots.txt file.

Today I spotted a thread from a webmaster in the Google Webmaster Help forums where Google was crawling the mobile version of the robots.txt file, which does not exist.

In short, it was trying to crawl /robots.txt?m=1. In this case, it is not really something this webmaster can control, being that he is on Google’s Blogger system.

Here is a screen shot of the error:

Google’s John Mueller told the webmaster he would relay the issue to the Blogger team but he doesn’t need to worry. John wrote:

Yes, these errors can get messy in Google Webmaster Tools.

Forum discussion at Google Webmaster Help.

Image credit to BigStockPhoto for 404 skull