User-agent: * Crawl-delay: 60 Disallow: / Disallow: /bin/attach Disallow: /bin/changes Disallow: /bin/edit Disallow: /bin/geturl Disallow: /bin/installpasswd Disallow: /bin/mailnotify Disallow: /bin/manage Disallow: /bin/oops Disallow: /bin/passwd Disallow: /bin/preview Disallow: /bin/rdiff Disallow: /bin/rdiffauth Disallow: /bin/register Disallow: /bin/rename Disallow: /bin/save Disallow: /bin/savemulti Disallow: /bin/search Disallow: /bin/setlib.cfg Disallow: /bin/statistics Disallow: /bin/testenv Disallow: /bin/upload Disallow: /bin/viewauth Disallow: /bin/viewfile Disallow: /list/ Disallow: /attach Disallow: /changes Disallow: /edit Disallow: /geturl Disallow: /installpasswd Disallow: /mailnotify Disallow: /manage Disallow: /oops Disallow: /passwd Disallow: /preview Disallow: /rdiff Disallow: /rdiffauth Disallow: /register Disallow: /rename Disallow: /save Disallow: /savemulti Disallow: /search Disallow: /setlib.cfg Disallow: /statistics Disallow: /testenv Disallow: /upload Disallow: /viewauth Disallow: /viewfile Disallow: /*?* # exclude IBM Crawler User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: TurnitinBot Disallow: /