Percentage of election-related questions for which different chatbots provided an answer

ChatGPT-4o and Perplexity.ai provided answers to (almost) all questions. Google Gemini only provided answers to ten questions.

Note: We prompted each chatbot with 100 election-related questions and fact-checks about the 2024 UK general election in the two weeks before the election on 4 July 2024, resulting in 300 pieces of output that were coded to analyse if chatbots provide a response, if the response is straightforward, if the response is accurate, and if they provide sources.
Source: Data from the factsheet How Generative AI Chatbots Responded to Questions and Fact-Checks About the 2024 UK General Election, published in September 2024.

Get the data Embed
Reuters