# Robots.txt file from http://www.spooners.com # # All robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /guest/ Disallow: /www_site_files/ Disallow: /guest/ Disallow: /stats/ Disallow: /stats_back/ Disallow: /webstats/