# http://www.robotstxt.org/wc/exclusion.html#robotstxt # # HK 11-10-2005: Bezoek van robots behalve Googlebot levert niets op... # User-agent: Googlebot Disallow: # Archief websites (http://www.archive.org/about/faqs.php#The_Wayback_Machine) # User-agent: ia_archiver Disallow: User-agent: * Disallow: /