# www.robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ user-agent: * disallow: /assets/ User-agent: Googlebot Disallow: User-agent: AdsBot-Google Disallow: User-agent: Googlebot-Image Disallow: