# 1) Google’s main crawler User-agent: Googlebot Allow: / # 2) Google’s mobile crawler User-agent: Googlebot-Mobile Allow: / # 3) Google AdSense crawler User-agent: Mediapartners-Google Allow: / # 4) Google’s image crawler with custom path restrictions User-agent: Googlebot-Image Disallow: /eclick Disallow: /settings Disallow: /landing Disallow: /cashback Disallow: /cashout Disallow: /help Disallow: /blog Disallow: /product # 5) Bing’s crawler User-agent: bingbot Disallow: / # 6) Everything else: blocked User-agent: * Disallow: /