# CRELoaded Generated Robots.txt # Robot Exclusion File -- robots.txt # Author: CRELoaded Team # Last Updated : May 21st 2009 User-Agent: * Disallow: *.mp3 Disallow: *.gif Disallow: *.jpg Disallow: *.png #To prevent only select bots from any scans User-agent: cyberalert.com User-agent: crawlers.looksmart.com User-agent: Googlebot-Image Disallow: /