TermAI bots & crawlers

IETF (Internet Engineering Task Force)

The group that sets internet standards. robots.txt (RFC 9309) and Web Bot Auth go through it.

Last updated November 7, 2026

See which AI agents visit your site, and what they came for.

DNA is free for every site.