# robots.txt for http://www.ctcrubber.com User-agent: * Disallow: /fr/ Disallow: /en/about.aspx