User-agent: Google Allow: User-agent: * Disallow: /webpage/ Disallow: /cgi-bin/ Disallow: /mdb-database/ Disallow: /asp/ User-agent: EmailCollector Disallow: / User-agent: Teleport Disallow: / User-agent: NetAttache Disallow: / User-agent: Black Hole Disallow: / User-agent: webmirror Disallow: / User-agent: webcopy Disallow: / User-agent: WinHTTrack Disallow: / User-Agent: Googlebot-Image Disallow: / User-agent: website extractor Disallow: /