OpenAI used the subreddit, r/ChangeMyView, to create a test for measuring the persuasive abilities of its AI reasoning models.
OpenAI collects user posts from r/ChangeMyView and asks its AI models to write persuasive replies to change the Reddit user's mind on a subject.
The responses generated by AI models are compared to human replies for the same post to assess their persuasiveness.
OpenAI's latest AI models perform within the top 80-90th percentile of humans in terms of persuasive argumentation abilities, as per the o3-mini system card.