User-Agent: * Disallow: /internal_docs Disallow: /cms Disallow: /cmsimages Disallow: /cmsfiles Allow: / Disallow: /general