Researchers warn that AI compliance layers designed to oversee government decisions can become tools for political manipulation
arXiv cs.AI · 2026年4月25日
AI要約
•Researchers at arXiv published a formal analysis showing how governments are embedding AI into administrative decisions (benefits approvals, license processing, welfare eligibility) wrapped in compliance layers meant to ensure those decisions stay legally defensible and reviewable.
•The problem: compliance safeguards that initially improve oversight can paradoxically make systems easier for future administrations to game — they learn exactly which rule-bending stays within the 'approval boundary' the compliance layer permits, letting them automate questionable decisions while appearing lawful.
•For government workers and citizens: automated benefit denials or license rejections may become harder to appeal if a new administration systematically rewrites the rules inside that compliance layer without triggering obvious legal red flags. For policymakers: scaling up AI automation now may lock in decision-making patterns that prove difficult to reverse or reform later.