AIToday

Study of 600+ simulations reveals four language models process ethical instructions in fundamentally different ways, with Llama showing unique Japanese dissociation pattern.

arXiv cs.CLApr 3, 20261 min read
Study of 600+ simulations reveals four language models process ethical instructions in fundamentally different ways, with Llama showing unique Japanese dissociation pattern.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. Researchers tested Llama 3.3 70B, GPT-4o mini, Qwen3-Next-80B-A3B, and Sonnet 4.5 across four ethical instruction formats using multi-agent simulations in English and Japanese

  2. Confirmed that Llama's Japanese dissociation pattern from prior research is model-specific, with other three models failing to replicate this behavior

  3. Created three new metrics—Deliberation Depth (DD), Value Consistency Across Dilemmas (VCAD), and Other-Recognition Index (ORI)—to measure how models process ethics

  4. Identified four distinct ethical processing types, including GPT's 'Output Filter' approach (safe outputs without internal processing) and Llama's 'Defensive Repetition' (high consistency through formulaic responses)

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →