User-agent: * Disallow: /doc/ Disallow: /jumps.html Disallow: /dict/vms/data/ Disallow: /cgi-bin/dnewsweb Disallow: /cgi-bin/calendar Disallow: /kalender/ Disallow: /cgi-bin/murdekaart.cgi Disallow: /internal/ Disallow: /corpus/lehed/ Disallow: /AT/2011/ Disallow: /dokumendiregister/2011/ User-agent: HTTrack Disallow: /