# This file restricts where link-checkers (robots) can go # # see for an explanation. User-agent: * # All spiders should avoid Disallow: /cgi-bin/ # scripts Disallow: /bin/ # scripts Disallow: /gifs/ # Graphics Disallow: /images/ # Graphics