#Fasterfox darf nichts prefetchen User-agent: Fasterfox Disallow: / #Diese Bots dürfen nichts User-agent: aiHitBot User-agent: Nutch User-agent: proximic User-agent: Sosospider User-agent: Speedy User-agent: Yeti Disallow: / #Alle anderen dürfen fast alles #Ask Jeeves, Googlebot, ia_archiver, msnbot, Yahoo! Slurp, User-agent: * Disallow: /ajax.php Disallow: /cbtest.htm Disallow: /history.php Disallow: /phpinfo.php Disallow: /webscanner.php Disallow: /webscanner.txt Disallow: /satz/ Disallow: /cb/ Disallow: /crm/ Disallow: /goldrausch/ Disallow: /icc/ Disallow: /logs/ Disallow: /statistik/