Original post on mindly.social

Oh, this is #fun.

#Applebot - Apple's web crawler, used for various things - is ignoring robots.txt rules governing crawling of websites.

I have Applebot (and Applebot-Extended, which isn't really a crawler) in my robots.txt files, set to disallow all access. Has been that way for #yonks.

And […]

Good to know, who is looking over your shoulder...

100 bot-visits, just today! That's sick...

#Amazonbot and #Applebot for the most part, but also #GPTBot and some others. Makes me puke... 😡

#wordpress #unwanted

Apple updates its Applebot documentation explaining what it means to block Applebot-Extended vs Applebot www.seroundtable.com/apple-update...

#apple #applebot #seo #ai

How to Opt Out of AppleBot So Apple Won’t Train AI on Your Websites Here's how to opt out of AppleBot, Apple's web crawler used to scrape public data and train its AI models.

Comment éviter de se faire crawler par Apple Bot mspoweruser.com/how-to-opt-o... #applebot #robotstxt #seo

Apple updates its Applebot documentation with Applebot-Extended, Reverse DNS, more user agents and so much more www.seroundtable.com/apple-update... hat tip @glenngabe.bsky.social
#apple #applebot #applesearch #search #robots