ClaudeBot is currently doing something really stupid. It somehow has
come to the conclusion that my Devuan mirror mirrors EVERYTHING!
So it's probing my mirror looking for things like rpms, jars, npn, cpan
packages, etc, and specifically looking in directories named after other
operating systems or package collections. Even stuff I have never heard
of. I certainly don't mirror any of it, only Devuan.
And it's doing it stupidly. It obviously knows what to expect, since it
keeps asking me for the actual packages and metadata files that would be
there if I was mirroring that particular thing. For example failing to
download several rpm files from a directory that is named after some rpm
based distro. After the first failure, it should figure out I'm not
mirroring that, give up. On top of that, these are mirrors it is
probing, the word "mirror" is even in some of the paths, they should all
be identical. If it already knows what to expect, it doesn't need to
download it yet again.
This may be going on with other mirrors, though some of them do mirror
other things as well. All it's doing is wasting bandwidth and space for
log files. Slowing everything down. And clogging up the AI with lots of
duplicates of binary files.