# =========================================== # Disallow aggressive scrapers and SEO audit bots # =========================================== # Semrush User-agent: SiteAuditBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-BA Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SemrushBot-OCOB Disallow: / User-agent: SemrushBot-FT Disallow: / User-agent: SemrushBot-ESI Disallow: / User-agent: SplitSignalBot Disallow: / # Ryte.com User-agent: RyteBot Disallow: / # Ahrefs User-agent: AhrefsBot Disallow: / # SE Ranking User-agent: SERankingBot Disallow: / # SEO PowerSuite User-agent: SEO PowerSuite Disallow: / User-agent: RankTracker Disallow: / User-agent: LinkAssistant Disallow: / User-agent: SEO SpyGlass Disallow: / User-agent: WebsiteAuditor Disallow: / # Majestic User-agent: MJ12bot Disallow: / # Moz User-agent: rogerbot Disallow: / # DotBot User-agent: DotBot Disallow: / # Petal Search User-agent: PetalBot Disallow: / # Bytespider User-agent: Bytespider Disallow: / # Baidu User-agent: Baiduspider Disallow: / # Barkrowler User-agent: Barkrowler Disallow: / # DataForSeo User-agent: DataForSeoBot Disallow: / # Seekport User-agent: SeekportBot Disallow: / # WebDataStats User-agent: WebDataStats Disallow: / # Alibaba Security Bot User-agent: AliyunSecBot Disallow: / # =========================================== # Rules for all search engines and crawlers # =========================================== User-agent: * Disallow: /agreement/ Disallow: /counter/ Disallow: /site/setlocale/ Disallow: /user/ Disallow: /*?*sort= Disallow: /*?*_csrf= Sitemap: https://superxgirls.com/sitemap.xml