Resources

Guides and research to see, manage, and monetize AI traffic.

Start here · 12 min read

Get your site ready for AI agents

The definitive guide

AI agents now visit your site for three kinds of clients: AI companies training models, search tools building answers, and your own customers asking questions or buying. Most sites treat them all the same. This guide explains who they are, what each one wants, and what to do first.

What you’ll learn

  • The four kinds of AI agents, and which ones bring you customers
  • Where robots.txt falls short
  • How to spot a fake agent using a real name
  • Three first steps you can take this week
Read the guide
Agent-readyMuseChatGPTClaude

Discover & learn

Guides for stores, publishers, and marketing teams.

AI shopping

How AI shopping agents find and buy from your store

Five checks before Black Friday.

AI traffic & analytics

How to measure the AI traffic your analytics misses

Most analytics tools skip agents by design.

AI bots & crawlers

Should you block AI crawlers?

Block training if you want. Keep the agents working for your customers.

Reference

AI glossary

Every AI agent and term in your logs, in plain words.

Research

Insights from industry and customer data

  1. November 7, 2026

    How to track AI agents when Google Analytics can’t see them

    What analytics misses    46.6%of AI agent traffic went to retail and ecommerce sites, where it can pass for shoppers in Google AnalyticsHUMAN, 2025
  2. November 5, 2026

    How to opt your website out of AI training with robots.txt

    What the opt-out covers    152sites block only companies the opt-out covers; 1,191 still need named rulesof 1,343 that block training crawlers
  3. November 2, 2026

    How to charge AI crawlers without charging your customers

    Who should pay    4,056pages Perplexity’s crawlers take for every visitor they send back; Google’s take 4.8Cloudflare Radar, October 2026
  4. October 30, 2026

    Web traffic nearly doubled, and blocking AI crawlers now costs sales

    What blocking costs    482top sites block OpenAI’s search crawler, which keeps them out of ChatGPT search answersof 5,577 readable robots.txt files
  5. August 4, 2026

    The verifiability gap

    What agents can prove    95.8%of known bots publish nothing a site can check, only a name2,083 of 2,175 bots
  6. July 24, 2026

    Lists of bot names miss the agents that matter now

    What sites declare    71%of sites that block Anthropic’s training crawler have no rule for its agents that answer people598 of 840 sites

See which AI agents visit your site, and what they came for.

Sign up free

DNA is free for every site.