# Robot-Manager was used to generate this file. # Copyright (c) 2001 by Sophtware.com, Inc. All Rights Reserved. # http://www.websitemanagementtools.com/ # PARTIAL access (Alta Vista) User-agent: Scooter Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ Disallow: /cgi-bin/ # PARTIAL access (Entire Web) User-agent: speedy Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # PARTIAL access (EuroSeek) User-agent: Freecrawl Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # PARTIAL access (Excite) User-agent: ArchitextSpider Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # PARTIAL access (Google) User-agent: Googlebot Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # NO access (Google Image) User-agent: Googlebot-Image Disallow: / # PARTIAL access (Inktomi) User-agent: Slurp Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # PARTIAL access (Lycos) User-agent: Lycos_Spider_(T-Rex) Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # PARTIAL access (Mirago) User-agent: mirago Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # PARTIAL access (Northern Light) User-agent: Gulliver Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # PARTIAL access (SearchUK) User-agent: MegaSheep Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # PARTIAL access (whatUseek) User-agent: winona Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ # PARTIAL access (All Spiders) User-agent: * Disallow: /400.shtml Disallow: /401.shtml Disallow: /403.shtml Disallow: /404.shtml Disallow: /500.shtml Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_inf.html Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/