# This is a file retrieved by spiders that conform to some sort # of standard. # See # # The webmaster for this site is # # Format is: # User-agent: '*' is all spiders # Disallow: | # Date By Reason # # 20011125 smcgough Installed the original file # 20020224 smcgough Updated file list below # 20030723 smcgough Created new file for Dreamweaver MX project # 20040114 smcgough This file updated # 20050312 smcgough Updated again # # -------------------------------------------- User-agent: * # The following are folders that should be skipped Disallow: /advert/ Disallow: /images/ Disallow: /mail/ Disallow: /partners/ Disallow: /phpmy/ Disallow: /cgi-bin/ Disallow: /divenass/ Disallow: /stats/ Disallow: /Templates/ Disallow: /padi/ Disallow: /dt/ Disallow: /dtb/ Disallow: /reservations_old/ Disallow: /tp/ Disallow: /xoc/ Disallow: /rsd/ Disallow: /phpmy/ Disallow: /reservations/ Disallow: /news/ Disallow: /g/ Disallow: /pdf/ Disallow: /video/ # # The following are files that should be skipped Disallow: agentap.htm Disallow: issues.htm Disallow: confap.htm Disallow: confirm.htm Disallow: exclusive.htm Disallow: postinfo.html Disallow: scptcall.js Disallow: storm.htm Disallow: updates.htm Disallow: style.css Disallow: whois.htm Disallow: error401.htm Disallow: error404.htm Disallow: favicon.ico Disallow: giveaways.htm Disallow: privacy.htm Disallow: video.htm Disallow: wetsuit.htm Disallow: downloads Disallow: register_conf.htm Disallow: register_error.htm Disallow: register_success.htm Disallow: register_unsub_confirm.htm Disallow: register_unsub_error.htm