Priming LLMs with consumer behavior reduces, but does not eliminate, error in product rankings

Percentage of respondents who said they would be "most likely" to try each of six hypothetical new fall-themed beverages from Starbucks*

(Please use a modern browser to see the interactive version of this visualization)

*Respondents were given text descriptions of each beverage, such as: "Spice Spice Baby: A cheeky pumpkin spice latte with extra cinnamon kick and whipped cream swirls. Topped with a caramel drizzle and sprinkles — made for fun and Instagram snaps."

Source: Survey of 1,519 U.S. adults conducted Sept. 3–8, 2025