BotMatrix

AI crawler policy studio — educational / agent-facing utility

robots.txt is advisory. Cooperative crawlers may honor Allow/Disallow preferences; others may ignore them. A Disallow rule does not ensure AI vendors will refrain from training or crawling. BotMatrix drafts preferences — it does not enforce them.
Crawler Vendor Allow Disallow Path

Rows are known AI-related tokens. Path defaults to / (whole site). Review vendor docs before publishing.