# Domain: http://www.cgirb.com # All robots will spider the domain User-agent: * Disallow: # Disallow directory /myapp/ User-agent: * Disallow: /myapp/