:: Re: [DNG] Artificial Idiocy attacki…
Inizio della pagina
Delete this message
Reply to this message
Autore: Didier Kryn
Data:  
To: dng
Oggetto: Re: [DNG] Artificial Idiocy attacking mirrors.
Le 28/11/2025 à 10:42, Tomasz Torcz a écrit :
> On Thu, Nov 27, 2025 at 12:05:28PM +0000, g4sra via Dng wrote:
>>> ClaudeBot is currently doing something really stupid. It somehow has
>>> come to the conclusion that my Devuan mirror mirrors EVERYTHING!
>> Welcome to the AI future.
>> anthropic.com have been having bad press since last year and don't appear to care how much upset they cause.
>>
>> Using Agent Headers or robots.txt is pointless as the aggressor cannot
>> be trusted to be honest. I am currently looking for some form of
>> proactive\reactive dynamic firewall blocking for this type of
>> 'attack'.  I am also investigating if I can tarpit (without causing
>> myself significant overhead) to actually slow down probes onto my
>> network by causing heightened resource usage at the aggressor's end.
>>
>> If you know of anything that  may help please give me a head-up.
>    LWN recently had a writeup on this problem: https://lwn.net/Articles/1008897/
> Many sites started using https://anubis.techaro.lol/ to repent the bots.
>

    Among other reasons why this AI sends you requests may be that some
search engine has noticed the existence of your server. It is normally
possible to include in an HTML header the clause <meta name="robots"
content="none"> to keep the search engines away.

    But I think you don't send HTML files. In this case, you could
instruct your http server to add the following line to every HTTP header:

X-Robots-Tag: noindex, nofollow

    Ive read it is possible to configure Nginx and Apache to do that.

--     Didier