# # This is an empty robots.txt file that can be used to indicate to # WWW robots which parts of a web site should not be indexed. # # Following page has details on how to setup a robots.txt file and # related security issues: # # http://www.chami.com/tips/internet/010198I.html # # 1. Uncomment following two lines by removing "#" at the beginning to # indicate that all robots should stay away from the /cgi-bin/ folder User-agent: * Disallow: /cgi-bin/ Disallow: /graphics/ Disallow: /private/ Disallow: /images/ Disallow: /style/ Disallow: /images_stat/ Disallow: /workshops/ Disallow: /error/ Disallow: /issi/ Disallow: /~xavier/ Disallow: /~saliba/ Disallow: /~pauluhn/ Disallow: /~taylor/ Disallow: /~haaland/ Disallow: /~kallenbach/ Disallow: /~vsteiger/ Disallow: /staff.html Disallow: /past_staff.html Disallow: /test/ Disallow: /html/test/ Disallow: /html/internal/ Disallow: /html/spotlight/ Disallow: /html/spotlight.html # 2. Following two lines indicate that robots named "WWW_Robot_Name" # should stay away from this site. #User-agent: WWW_Robot_Name #Disallow: / # 3. Following two lines indicate that robots named "WWW_Wanderer_Name" # should not index files in the /private/ folder. #User-agent: WWW_Wanderer_Name #Di