# Robot Info -- http://www.robotstxt.org/wc/robots.html User-agent: * Disallow: /cgi-bin/ # Disallow ia_archiver (http://web.archive.org/) -- 2.Jun.04 User-agent: ia_archiver Disallow: /