User-agent: * Disallow: /cgi-bin/ Disallow: /oldsite/ Disallow: /test/ Disallow: /domains/ Disallow: /subdomains/ Disallow: /com/