AIToday

AI agents marketed as coworkers hurt human oversight, study finds

MIT Technology Review AI12h ago5 min read
AI agents marketed as coworkers hurt human oversight, study finds

Key takeaway

A new study shows that calling AI agents "employees" or "coworkers" makes humans less careful about checking their work, not more productive. Researchers found people caught 18% fewer errors when an AI tool was labeled as an employee. As companies roll out AI agents in healthcare and government, this framing could obscure human responsibility for system failures.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    Research by Boston University professor Emma Wiles found that when AI agents are framed as "employees" rather than software tools, people catch 18% fewer errors in their work. Nearly a third of 1,261 managers surveyed said their companies already frame AI agents as employees, with some listing them on organizational charts.

  • Why it matters

    When AI tools are labeled as coworkers, humans feel less responsible for their output and are 44% more likely to escalate questionable work to a manager instead of correcting it themselves—defeating the time-saving purpose of using the agent. As AI agents move into healthcare, warfare, education, and government, this dynamic risks creating a convenient place to blame failures that actually stem from human decisions and oversight.

  • What to watch

    At Stanford, researchers asked 1,500 workers across 104 jobs which tasks AI could actually help with in their roles. Workers often rejected tasks that tech experts deemed most suitable for AI automation, suggesting a gap between what companies assume workers need and what workers themselves want from AI tools.

FAQ

What did the research show about how people treat AI agents differently?
When an AI tool was framed as an employee, participants saw themselves as less responsible for its output and were 44% more likely to escalate questionable work to a manager rather than correcting it themselves. People also caught 18% fewer errors in work supposedly done by an agentic "AI employee" versus a chatbot.
How are companies currently using this employee framing?
Nearly a third of the 1,261 managers in the study said their companies already frame AI agents as employees, with some listing them on organizational charts. Since April, Microsoft, OpenAI, Anthropic, and Google have all released new tools oriented toward managing teams of AI agents, many explicitly advertised as digital colleagues.
What did workers actually want from AI tools in their jobs?
Researchers at Stanford presented 1,500 workers across 104 jobs with information about what tasks AI could do and asked what would be most helpful. Workers wanted automation in certain areas—for example, law clerks thought AI could help track progress across cases—but often rejected tasks experts deemed suitable, like verifying customer credit ratings for sales representatives.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →