# robots.txt - crawler configuration file User-agent: * Disallow: /_includes/ Disallow: /_private/ Disallow: /aspnet_client/ Disallow: /database/ Disallow: /images/ Sitemap: http://www.warkeys.net/sitemap.xml