# Robots.txt file from http://www.huxtins.com # # All robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /www_site_files/ Disallow: /guest/ Disallow: /stats_back/ Disallow: /stats/ Disallow: /webstats/ Disallow: /wwwboard/ Disallow: /private/ Disallow: /david/