RFC 9309
The official robots.txt standard, published by the IETF in 2022. It says robots.txt rules don't control access.
Last updated November 7, 2026
← All entriesThe official robots.txt standard, published by the IETF in 2022. It says robots.txt rules don't control access.
Last updated November 7, 2026
← All entries