User-agent: * Disallow: /cgi-bin User-agent: almaden User-agent: ASPSeek User-agent: baiduspider User-agent: dumbBot User-agent: Generic User-agent: grub-client User-agent: MSIECrawler User-agent: NexaBot User-agent: ia_archiver User-agent: NPBot User-agent: OWR_Crawler User-agent: psbot User-agent: rabaz User-agent: NaverBot-1.0 User-agent: RPT-HTTPClient User-agent: ScoutAbout User-agent: semanticdiscovery User-agent: TurnitinBot User-agent: Wget Disallow: /