19
edits
Changes
→Throttling
* Google
# Log in to [https://www.google.com/webmasters/tools Google Webmaster Tools]
# Select your site
# In the left-hand side, select '''Configuration''' and then '''Settings'''
Note: This may take a day or two to go into effect and '''it only lasts for 90 days''', at which point it will revert back to Google selecting the crawl rate.
* Bing
# Log in to [http://bing.com/webmaster Bing Webmaster Tools]
# Select your site
# In the left-hand side, select '''Configure My Site''' and then '''Crawl Control'''
# Use the 2D chart to change the crawl rate for specific times of day. Or you can use the drop-down menu to move crawl activity to off-peak hours of traffic.
Note: Directives in robots.txt will override this setting (e.g. Setting <tt>Crawl-delay</tt>)
== Sitemaps ==
