state,domains_checked,responded,valid_robots_txt,blocks_chatgpt_search_allows_google,pct_of_valid_chatgpt,blocks_ai_search_crawlers_allows_google,pct_of_valid_crawlers,blocks_ai_search_incl_user_fetchers_allows_google,pct_of_valid_incl_user,note
ALL (state & local),15331,12298,6765,353,5.2,374,5.5,385,5.7,"Totals. Percentages use sites with a valid robots.txt as the base. 3 domains have no state in the CISA list. Source: joshblackburn.co/studies/ai-crawler-access/, data collected October 24, 2026."
AK,44,32,17,0,0.0,0,0.0,0,0.0,
AL,267,196,107,5,4.7,6,5.6,6,5.6,
AR,419,248,185,4,2.2,5,2.7,5,2.7,
AS,6,6,4,,,,,,,suppressed: fewer than 10 sites with a robots.txt
AZ,270,226,95,1,1.1,1,1.1,1,1.1,
CA,799,640,296,12,4.1,13,4.4,14,4.7,
CO,284,220,112,4,3.6,4,3.6,4,3.6,
CT,188,159,75,2,2.7,2,2.7,2,2.7,
DC,22,12,9,,,,,,,suppressed: fewer than 10 sites with a robots.txt
DE,24,22,15,0,0.0,0,0.0,0,0.0,
FL,553,446,241,14,5.8,14,5.8,14,5.8,
GA,359,290,135,1,0.7,3,2.2,3,2.2,
GU,3,3,3,,,,,,,suppressed: fewer than 10 sites with a robots.txt
HI,16,11,4,,,,,,,suppressed: fewer than 10 sites with a robots.txt
IA,230,180,71,9,12.7,9,12.7,9,12.7,
ID,105,80,49,3,6.1,3,6.1,3,6.1,
IL,467,349,205,6,2.9,7,3.4,9,4.4,
IN,156,121,68,0,0.0,0,0.0,0,0.0,
KS,256,200,104,4,3.8,6,5.8,6,5.8,
KY,240,189,97,1,1.0,2,2.1,2,2.1,
LA,130,91,53,3,5.7,3,5.7,3,5.7,
MA,371,320,109,6,5.5,6,5.5,7,6.4,
MD,129,110,60,3,5.0,4,6.7,4,6.7,
ME,147,134,67,9,13.4,9,13.4,9,13.4,
MI,643,530,351,11,3.1,13,3.7,13,3.7,
MN,621,552,329,72,21.9,72,21.9,72,21.9,
MO,376,269,155,4,2.6,4,2.6,4,2.6,
MP,3,2,2,,,,,,,suppressed: fewer than 10 sites with a robots.txt
MS,132,85,54,3,5.6,3,5.6,3,5.6,
MT,141,111,71,2,2.8,2,2.8,2,2.8,
NC,403,331,178,16,9.0,16,9.0,16,9.0,
ND,77,55,31,6,19.4,6,19.4,6,19.4,
NE,162,115,53,0,0.0,0,0.0,0,0.0,
NH,234,181,82,7,8.5,7,8.5,7,8.5,
NJ,336,271,141,11,7.8,12,8.5,12,8.5,
NM,99,87,44,0,0.0,0,0.0,0,0.0,
NV,53,41,16,1,6.2,1,6.2,1,6.2,
NY,1441,1268,799,26,3.3,26,3.3,29,3.6,
OH,707,529,301,5,1.7,6,2.0,8,2.7,
OK,243,146,87,3,3.4,3,3.4,3,3.4,
OR,290,235,130,6,4.6,6,4.6,6,4.6,
PA,396,316,182,12,6.6,13,7.1,13,7.1,
PR,8,5,4,,,,,,,suppressed: fewer than 10 sites with a robots.txt
RI,64,56,29,3,10.3,3,10.3,3,10.3,
SC,154,124,61,1,1.6,1,1.6,1,1.6,
SD,67,50,28,2,7.1,2,7.1,2,7.1,
TN,359,282,128,4,3.1,4,3.1,5,3.9,
TX,760,636,272,16,5.9,17,6.2,17,6.2,
UT,406,375,263,5,1.9,5,1.9,6,2.3,
VA,245,198,84,5,6.0,6,7.1,6,7.1,
VI,6,5,4,,,,,,,suppressed: fewer than 10 sites with a robots.txt
VT,104,92,53,7,13.2,9,17.0,9,17.0,
WA,236,198,82,4,4.9,4,4.9,4,4.9,
WI,833,681,467,34,7.3,35,7.5,35,7.5,
WV,163,120,72,0,0.0,1,1.4,1,1.4,
WY,81,64,30,0,0.0,0,0.0,0,0.0,