Wholesalers Can Submit URLs to Google with Fetch as Googlebot

August 5th, 2011

by Claudia Bruemmer

Wholesalers and general merchandise vendors can now submit their new and updated URLs to Google for indexing with the Fetch as Googlebot feature in Webmaster Tools, as announced in the Google Webmaster Central Blog August 3. This new feature allows your site to be reviewed faster than waiting for Google’s regular crawling process.

The Fetch as Googlebot tool lets you see a page as the Googlebot sees it and is also useful if you’re troubleshooting a page’s poor performance in search results. What you do to submit URLs is fetch a URL as Googlebot, and if your fetch is successful, you’ll then see the option to submit that particular URL to Google’s index.

The Googlebot will then crawl the URL within 24 hours and consider it for inclusion in the Google index. This fast crawl can get your site reviewed sooner than waiting for the googlebot to find it on regular crawls. It can also be used to clear out the currently cached version of your site.

Google does not guarantee that every URL submitted in this manner will be indexed, as they still depend largely on their regular crawling process to evaluate URLs.

New Fetch Functionality and Limitations
If you need to call Google’s attention to new product pages quickly, the new Fetch as Googlebot feature can come in handy. Fetch allows you to see your site pages exactly as the googlebot crawler does. More importantly, it allows you to tell Google to index that page. If you need to update product pages as your inventory changes, or if you are submitting a brand new site, you can even submit the fetched page and all the pages connected to it.

Google limits the total number of “fetches” to 50 per week. When submitting a page and all pages connected to it, there is a limit of 10 per month. Google also has a new crawl request form. The new form is for pages that aren’t verified, and these same submission limits apply to the crawl form.

When to Use Fetch
As you know, Google’s ability to index content quickly has improved dramatically over the last year or two. In most cases sites and pages index pretty fast. However, there may be times when you need certain pages indexed right away. The Google Webmaster Blog entry touches on this issue and gives a couple examples. For instance, you might have a page with content about an event that is just a few days away − that’s when you’ll want to use Fetch.

To review: wholesalers and general merchandise vendors can now submit their URLs directly to Google with Fetch for Googlebot. Also keep in mind that Fetch as Googlebot can be used if you have a new site without a lot of inbound links, as it will move the site into Google’s index within 24 hours. Additionally, if you need to get rid of the currently cached version of your site, you can do it with Fetch, and the googlebot will recheck your site within 24 hours.

Wholesale News : Wholesalers, Manufacturers , Retailers and Dropshippers


Trackback URI | Comments RSS

Leave a Reply

You must be logged in to post a comment.