User-agent: * Disallow: /404/ Disallow: /aspnet_client/ Disallow: /nomad/ Disallow: /client/ Disallow: /css/ Disallow: /imgs_cabs/ Disallow: /imgs_navi/ Disallow: /imgs_site/ Disallow: /imgs_vndr/ Disallow: /js/ Disallow: /searchidx/ Disallow: /stats/ Disallow: /swf/ Disallow: /archived/ Disallow: nomad.htm Disallow: indexlcc.htm Disallow: index-layer.htm Disallow: gdform.asp # User-agent: Googlebot User-agent: InfoNaviRobot User-agent: TV33_Mercator User-agent: AVSearch User-agent: Mercator User-agent: Scooter User-agent: Slurp User-agent: SearchengineLicenceSheep User-agent: shadow User-agent: MultiText User-agent: FAST-WebCrawler User-agent: Lycos_Spider User-agent: Atomz User-agent: htdig User-agent: spider00.logika.net User-agent: NetMechanic User-agent: libwww-perl User-agent: Teleport Pro # updated 2008-02-27(disallow links, new bot file)