# robots.txt - Limits spider bots in their indexing capability User-agent: * # Refuse robot requests for binary directories Disallow: /cgi-bin/ Disallow: /downloads/ Disallow: /images/ Disallow: /personal/ Disallow: /agreements/ Disallow: /includes/