# Bloque tous les bots non essentiels (scraping massif observé) User-agent: GPTBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: PetalBot Disallow: / User-agent: Applebot Disallow: / # Exceptions : autoriser Google et Bing User-agent: Googlebot Allow: / User-agent: bingbot Allow: / User-agent: BingPreview Allow: / # Par défaut, autoriser humains et navigateurs User-agent: * Disallow: