User-agent: * # Do not delete /Sitefinity. Never any reason to allow indexing here Disallow: /Sitefinity # The same goes for sandbox Disallow: /sandbox # Also disallow search. We already have it set to "noindex", but keep getting googlebot hits Disallow: /search-results Disallow: /home/membership/member-directory/member-search---lenders # At launch, remove this Disallow. Add any other folders that should not be indexed Crawl-delay: 120