View Full Version : How to change the crawler frequency for my Website?

04-06-2015, 05:32 AM
How to change the crawler frequency for my Website

04-06-2015, 09:21 AM
You can't change the crawl rate for the sites, which are not at the root level. For example, www.example.com/folder. To change the crawl rate in Google webmaster tools, follow the following steps,

- On the Webmaster Tools Home page, click the site you want.
- Click the gear icon , then click Site Settings.
- In the Crawl rate section, select the option you want.

The new crawl rate will be valid for 90 days.

But changing the crawl frequency always cause some problems, like Google will not be able to crawl at a faster rate than the custom rate you set.