What is the Difference between Google Bot and Adsense Spider?
If you inspect the bots (program bots or spiders) crawling your webpage at any point of time, you might come across Google Bot, Yahoo Bot, Bing Bot etc. If you were lucky enough to see the Google Adsense Spider, you might wonder what it really does.
Basically you could classify these program bots or spiders into two: Engine Bots and Media Bots. The engine bots are nothing but Search engine spiders that continiously crawl the web for new content to be indexed into the Google Search Database. Media Bots like Adsense spider are Bots that crawl your websites to understand the type of content published on your website and serve related advertisments that are relavant to the content on your blog.
Please be informed that Mediabot or Adsense Spider also respects robots.txt file and settings. Hence please make sure you aren’t preventing it from crawling pages it needs to crawl.
In other words, both are entirely independent system and have different purpose of visiting your website. Ensure you allow both the Google engine and media bots to your website to experience continual indexing. Hope this has clarified your questions on the Adsesne Spider and Google Search engine bot. Feel free to write in your questions in the comments section below.