# robots.txt User-agent: * Disallow: /media/ Disallow: /css/ User-agent: Teleport* Disallow: / User-agent: Webwhacker Disallow: / User-agent: WebDevil Disallow: / User-agent: Webzip Disallow: / User-agent: Net Attache Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WX_mail/2.000 Disallow: / User-agent: EmailCollector Disallow: / User-agent: WhoWhere Disallow: / User-agent: Roverbot Disallow: / User-agent: ActiveAgent Disallow: / User-agent: EmailSiphon Disallow: /