# # This is the default robots.txt file for KD's EVAL sites. It prevents all # robots from indexing the page except for the htdig search engine that we're # using locally. # User-agent: * Disallow: / User-agent: W3C-checklink Disallow: User-agent: htdig Disallow: