# Robots Exclusion Standard file # read more from http://www.robotstxt.org/wc/exclusion.html User-Agent: * Disallow: / User-Agent: Googlebot Disallow: /images/ Allow: / Disallow: /public/