Google Spiders Everywhere

by Bonnie Calhoun

We've already discussed how to sign up for the search engines, including Google. See the post about Search Engines or click on the Label that I made for it.

Today I'm going to go through what it takes to make sure that your site is being crawled correctly by the spiders...LOL...That sounds cool, doesn't it?

One of the first things you need to be aware of is Google Blog Search Ping Service. You can ping your blog here to get Google to crawl it.

Then after you ping your blog, go and check for it to register on Google Blog Search. Now if it doesn't show up right away, don't worry!

Go sign yourself up with Google Alerts. When you sign up for this put the URL (address of your blog) in the top box, where it says search terms. The when your blog updates, you can tell how long it takes the spiders to crawl your blog, because Google will send you an email, every time you update!

Next thing...and I've addressed this in the Search Engine post is your site map. You can set this up with Google WebMaster Central. Now I can't say enogh good stuff about these tools on this site. You can set up your site map, you can find out if your site is being indexed by Google, a Help Center, and multiple other tools!

I gave you instructions before on how to setup your site map, but make sure that when your done you get the little (1) on the column that says site map. After you've set up your site map, check the crawl rate.

Click on the tool for setting up a site map. This will be the page where you get the little (1) under the site map column. Click on the title of your blog and it takes you to the Diagnostics page that tells you all about your crawl rate, the errors, and tools.

Your crawl rate should be set to normal because it will tell you that at the slower rate: "A slower crawl will reduce Googlebot's traffic on your server, but we may not be able to crawl your site as often."