# Robots.txt file created by http://www.maid4texas.com # For domain: http://www.maid4texas.com Sitemap: http://www.maid4texas.com/sitemap.xml # All robots will spider the domain User-agent: * User-agent: Googlebot User-agent: InfoNaviRobot User-agent: TV33_Mercator User-agent: AVSearch User-agent: Mercator User-agent: Scooter User-agent: Slurp User-agent: SearchengineLicenceSheep User-agent: shadow User-agent: MultiText User-agent: FAST-WebCrawler User-agent: Lycos_Spider User-agent: Atomz User-agent: htdig User-agent: NetMechanic User-agent: libwww-perl User-agent: MSNBot User-agent: Teoma User-agent: ia_archiver Disallow: /_private/ Disallow: /_derived/ Disallow: /_vti_cnf/ Disallow: /_vti_pvt/ Disallow: /ASPSecured/ Disallow: /cgi-bin/ Disallow: /cp/ Disallow: /metro/ Disallow: /webalizer/ Disallow: /client/ Disallow: /images/ Disallow: /thanks.html Disallow: /unsubscribe.html Disallow: /map.html Disallow: /confirmed.html