User-agent: Googlebot Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: MSNBot Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: Slurp Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: Teoma Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: Gigabot Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: Scrubby Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: Robozilla Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: Nutch Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: ia archiver Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: baiduspider Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ User-agent: * Disallow: /cgi-bin/ Disallow: / private/ Disallow: / vti bin/ Disallow: / vti cnf/ Disallow: / vti log/ Disallow: / vti pvt/ Disallow: / vti txt/ Disallow: /Mix-files/ Disallow: /stats/ Disallow: /advertise/signup.htm