Researchers propose Connections wordplay game as a new benchmark to measure AI agents' social intelligence and collaborative reasoning abilities.

Connections is an improvisational wordplay game designed to test AI agents' combined skills in knowledge retrieval, summarization, and understanding other agents' cognitive states

The benchmark goes beyond individual agent capabilities by requiring AI systems to gauge and adapt to the understanding levels of other agents in collaborative scenarios

Language model-based agents must demonstrate social awareness and intelligence when communicating in constrained environments to successfully play the game