Jump to: navigation, search

Robots Are Our Friends

487 bytes added, 18:15, 7 November 2012
no edit summary
"Sitemaps are an easy way for webmasters to inform search engines about pages on their sites that are available for crawling. In its simplest form, a Sitemap is an XML file that lists URLs for a site along with additional metadata about each URL (when it was last updated, how often it usually changes, and how important it is, relative to other URLs in the site) so that search engines can more intelligently crawl the site." --
The full specification is available at []
=== Creating a sitemap ===
[ List of sitemap generators] including Drupal and Wordpress.
Some library software specific sitemap generators exist:
* [ ContentDM] (locally hosted instances only)
*[ VUfind]
=== Telling Search Engine about your sitemap ===
Sitemaps can be added into your '''robots.txt''', or submitted directly to Google Webmaster Tools or Bing.
==== robots.txt ====add the a linelike this to your robots.txt file:
==== Google ====
# Log in to [ Google Webmaster Tools]
# Select your site

Navigation menu