User-agent: * Disallow: /cgi-bin/ Disallow: /htc/cgi-bin/ Disallow: /htc/old_texttext/ Disallow: /text/ Disallow: /2005/ # updated 2009-07-18 (disallow rtestprob links)