# - IT Robots- # For Iltrovatore User-Agent: IlTrovatore-Setaccio Disallow:/cgi-bin Disallow:/style Disallow:/form Sitemap: http://it.tiwatiwa.com/sitemap.xml # All Robots User-Agent: * Disallow:/cgi-bin Disallow:/style Disallow:/form # For AllTheWeb, Alexa, AltaVista, Exactseek, # Htdig, Jeeves, Inktomi Slurp, Kellysearch, # LinkWalker, Looksmart, Mozdex, Nameprotect # Nutch, ObjectsSearch, Turnitin, Walhello User-agent: Fast-Webcrawler User-agent: ia_archiver User-agent: Scooter User-agent: exactseek-pagereaper User-agent: htdig User-agent: Jeeves User-agent: Inktomi-Slurp User-agent: semanticdiscovery User-agent: LinkWalker User-agent: WISENutbot User-agent: mozDex User-agent: NPBot User-agent: NutchCVS User-agent: ObjectsSearch User-agent: TurnitinBot User-agent: appie Disallow:/cgi-bin Disallow:/style Disallow:/form # For Google User-agent: Googlebot Disallow:/cgi-bin Disallow:/style Disallow:/form # For Google Mediapartners User-agent: Mediapartners-Google Disallow:/cgi-bin Disallow:/style Disallow:/form # For Gigablast User-agent: Gigabot Disallow:/cgi-bin Disallow:/style Disallow:/form # For MSN User-agent: msnbot Disallow:/cgi-bin Disallow:/style Disallow:/form # For Mirago [UK] User-agent: mirago Disallow:/cgi-bin Disallow:/style Disallow:/form # For Picsearch User-agent: psbot Disallow:/cgi-bin Disallow:/style Disallow:/form # For Wget User-agent: Wget Disallow:/cgi-bin Disallow:/style Disallow:/form # For Wotbox.com User-agent: Wotbox Disallow:/cgi-bin Disallow:/style Disallow:/form # For Yahoo User-agent: Yahoo! Slurp Disallow:/cgi-bin Disallow:/style Disallow:/form # For Entireweb User-agent: Speedy Spider Disallow:/cgi-bin Disallow:/style Disallow:/form # - CN+TW+KR Robots - # For cn Baidu, Sohu; Naver.com kr; Openfind tw User-Agent: Baiduspider+ User-Agent: sohu-search User-Agent: NaverBot User-Agent: Openbot Disallow: / # - BY Robots- User-Agent: All.by Disallow: / # - RU Robots- User-Agent: Aport User-Agent: StackRambler Disallow: / User-Agent: yandex Disallow:/cgi-bin Disallow:/style Disallow:/form