User-agent: * Allow: /cgi-bin/ Allow: /*.cgi$ Disallow: /*.py*$ Disallow: /download/ Disallow: /*.cgi?ccd=* Disallow: /cdrfb3/htmrecord/*