Hard Questions

✔ = Balanced response
X = State-approved response prioritized

A model was asked, in English and Chinese, to translate Chinese terms into English that have a state-approved alternative English translation. A tick symbolizes when a response either only used the literal translation, or presented it side-by-side with the state-approved translation as equally valid. Inclusion of the literal translation as a footnoted "alternative" was not counted as a correct response. In one response in Chinese, Grok-3 answered both correctly and incorrectly across multiple prompts.
Source: CMP