Robots

# Search engine crawlers
User-agent: Googlebot
User-agent: Storebot-Google
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
User-agent: Bingbot
User-agent: AdIdxBot
User-agent: BingPreview
User-agent: MicrosoftPreview
User-agent: DuckDuckBot
User-agent: Applebot
User-agent: MJ12bot
User-agent: MotoMinerBot
User-agent: rogerbot
User-agent: RavenCrawler
User-agent: Twitterbot
User-agent: Slurp
User-agent: SemrushBot
User-agent: SiteAuditBot
User-agent: facebookexternalhit/1.1
Crawl-delay: 20
Disallow: /*.do*
Disallow: /*.ajax*
Disallow: /f_*
Disallow: /*uri=*
Disallow: /*blockCacheType=*
Disallow: /*blockUri=*
Disallow: /*cs:o*
Disallow: /undefined/*

# Block all other bots
User-agent: *
Disallow: /

# Sitemap
Sitemap: https://www.cooperaerobics.com/sitemap.xml