• Mwa@thelemmy.club
    link
    fedilink
    English
    arrow-up
    8
    ·
    19 hours ago

    The problem is Ai doesn’t follow robots.txt,so Cloudflare are Anubis developed a solution.