About
Applebot-Extended is a robots.txt control token rather than a crawler. Disallowing it opts your content out of Apple Intelligence foundation-model training; the actual fetching is still done by Applebot.
Apple Intelligence training
Details
- Type
- AI training control
- Operator
- Apple
- Access
- Direct — crawls on the operator’s own schedule
- Traffic rank
- Documentation
- https://support.apple.com/en-us/119829