# robots.txt file # www.sjchs.org # Version 3.3 - 4/3/09 # Updated 9/9/09 # BASIC robots.txt file for sitemaker websites. # Must be named "robots.txt" and be in the root folder. # Certain files excluded. # Exclude some User-agent: * Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT User-agent: Googlebot Disallow: /?src= Disallow: /body.cfm/ Disallow: /body.cfm.cfm Disallow: /Body Disallow: /Cancercare_Bo Disallow: /Cancercare_Ho #The following was added by http://www.sjchs.org/smm_googleadmin.cfm User-Agent: medseek-gsa-crawler Disallow: Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT Disallow: /secure Disallow: /images