User-Agent: * Crawl-Delay: 45 User-agent: * Disallow: /cgi-bin/ Disallow: /cgi/ Disallow: /buy/ Disallow: /order/ Disallow: /cart/ Disallow: /shop/ Disallow: /store/ Disallow: /catalog/ Disallow: /shopping/ Disallow: /pay/ Disallow: /conf/ Disallow: /includes/ Disallow: /inc/ Disallow: /go/ Disallow: /redir/ Disallow: /r/ Disallow: /display/ Disallow: /secure/ Disallow: /buynow/ Disallow: /user/ Disallow: /account/ Disallow: /url/ Disallow: /online/ Disallow: /commerce/