LLMs fail to replicate human rankings of products

Percentage of respondents who said they would be "most likely" to try each of six hypothetical new fall-themed beverages from Starbucks*

(Please use a modern browser to see the interactive version of this visualization)

*Respondents were given text descriptions of each beverage, such as: "Spice Spice Baby: A cheeky pumpkin spice latte with extra cinnamon kick and whipped cream swirls. Topped with a caramel drizzle and sprinkles — made for fun and Instagram snaps."

Source: Survey of 1,519 U.S. adults conducted Sept. 3–8, 2025