Changes

Jump to: navigation, search

Robots Are Our Friends

520 bytes added, 14:53, 7 November 2012
Throttling
== Throttling ==
 
* Google
# Log in to [https://www.google.com/webmasters/tools Webmaster Tools]
# Select your site
# In the left-hand side, select '''Configuration''' and then '''Settings'''
# Under '''Crawl rate''' select '''Limit Google's maximum crawl rate'''
# Use the slider to adjust the amount of requests per second/number of seconds between requests
# Hit '''Save'''
 
Note: This may take a day or two to go into effect and '''it only lasts for 90 days''', at which point it will revert back to Google selecting the crawl rate.
== Sitemaps ==
19
edits

Navigation menu