Proportion of top news websites blocking OpenAI's crawlers during 2023
USA
Denmark
Germany
India
Norway
UK
Brazil
Spain
Mexico
Poland
79%
79%
67%
67%
60%
60%
60%
60%
60%
60%
53%
53%
33%
33%
27%
27%
20%
20%
20%
20%
Some publishers blanket block all crawlers
Some publishers blanket block all crawlers
OpenAI crawlers launched
OpenAI crawlers launched
Note: Based on analysis of the robots.txt files from the 15 most widely used online news websites in each country (according to the 2023 Reuters Institute Digital News Report) sourced from the Wayback Machine. December 2023 data available for all websites except the Washington Post in the USA.
