Google Bot's And Spyders

when you start your home business, your going to need traffic to your website. The best way to get traffic to your website is by using SEO; or, search engine optimization. SEO is cheap because it's free and it can be more effective than using pay per click advertising by a long run. We will discuss more about search engine optimization later on, for now were going to discuss why you want good content, and how google and yahoo search the content on your website to give it a rating.

Google Bot Current version: Googlebot 2.1

A google bot works as a search bot; or, a search engine that uses web crawling bots to collect information from all over the web to construct a searchable index. These bot's work by searching the web and then reporting the information to all of googles services. Other terms are web crawlers, ants, automatic indexers, bots and worms or web robot.

OK, this part may be a tad confusing but make sure you have read all articles regarding seo so it all makes perfect sense.

To Allow Googlebot

User-agent: Googlebot

Allow: / (or list a directory or page that you want to allow)

To Block Googlebot

User-agent: Googlebot

Disallow: / (or list a directory or page that you want to disallow)

MSNbot, and yahoo slurp are the same thing as googlebots but they provide information exclusivly to there own web pages.

For more information about google bots please visit http://www.ahfx.net/weblog/39