# robots.txt file for restricting spiders searching the site User-agent: * Disallow: