################################################################################ # Clintonium Robots Handler (robots.txt) # This file provides access rules to compliant indexing robots/crawlers/spiders ################################################################################ # Tell the highly obnoxious and error-ridden NuSearch Spider to just go away # ------------------------------------------------------------------------------ User-agent: NuSearch Spider Disallow: / # Tell all other bots to ignore certain directories and pages # ------------------------------------------------------------------------------ User-agent: * Disallow: /library/ Disallow: /other/errors/