It is true that robots.txt are not enforceable. However, this leads to the quagmire that is what exactly is the definition of fair use and what exactly is copyrighted material, in this day and age.

I thought other ai based businesses don't respect robots.txt anymore. There was a Wired investigation on Perplexity recently.

The Onion should buy Elsevier next