# Robots.txt file from http://www.webdn.com # All robots will spider the domain User-agent: * Disallow: /arts/ Disallow: /free/car/ Disallow: /free/trans/ Disallow: /gold/game/n049/ Disallow: /gold/sports/ Disallow: /golf/envi/ Disallow: /hardware/ Disallow: /soft/ Disallow: /web_file/security/ Disallow: /web_file/security/bingdu/ Disallow: /COLOR/black/ Disallow: /HyperSnap/HyperSnap/ Disallow: /download/