We published a guide that collects the official policies of the major AI crawlers in one place.
It explains why each crawler visits your site and how to allow or block them in robots.txt, in table form.
If you want your pages to be cited more in AI answers, this is the first thing to check.