User-agent: * Disallow: User-agent: SemrushBot User-agent: MJ12bot User-agent: PetalBot User-agent: AhrefsBot User-agent: DotBot User-agent: MegaIndex User-agent: BLEXBot Disallow: / User-agent: AhrefsSiteAudit Allow: /