A fairly common question I see in the support forums is why is Google crawling my robots.txt file.
Today I spotted a thread from a webmaster in the Google Webmaster Help forums where Google was crawling the mobile version of the robots.txt file, which does not exist.
In short, it was trying to crawl /robots.txt?m=1. In this case, it is not really something this webmaster can control, being that he is on Google’s Blogger system.
Here is a screen shot of the error:
Google’s John Mueller told the webmaster he would relay the issue to the Blogger team but he doesn’t need to worry. John wrote:
Yes, these errors can get messy in Google Webmaster Tools.
Forum discussion at Google Webmaster Help.
Image credit to BigStockPhoto for 404 skull
