AIToday

Court allows broad discovery into insurer's AI coverage decisions

Top Companies AI — US (1/2)4h agoSend on LINE
Court allows broad discovery into insurer's AI coverage decisions

Key takeaway

A federal court in Minnesota ruled that an insurance company must allow discovery into how it used an AI tool called nH Predict to make Medicare coverage decisions, after plaintiffs claimed the tool replaced human clinician review promised in the policy documents. The court protected proprietary technical information like source code but required the insurer to disclose governance, training, oversight, and operational details about how the AI was actually used in practice. The ruling underscores that insurers must align their coverage decision processes with what their policies promise or face broad discovery and litigation risk.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    In Estate of Lokken v. UnitedHealth Group, the U.S. District Court for the District of Minnesota ruled that plaintiffs could obtain discovery into how UnitedHealth used its nH Predict AI tool in Medicare Advantage coverage decisions, including governance, training, and oversight records — but denied access to the tool's source code and underlying data.

  • Why it matters

    The ruling signals that insurers using AI in claims handling face broad discovery exposure when their policy documents promise clinician involvement; any gap between what the contract says and what actually happens in practice can trigger litigation and discovery risk. Insurers must align their workflows with their stated promises about human review.

  • What to watch

    Insurers should document how AI recommendations are generated, reviewed, and acted on by humans; maintain clear oversight procedures and training materials; and ensure policy language matches real-world decision-making processes to reduce discovery and litigation risk.

In Depth

In Estate of Gene B. Lokken v. UnitedHealth Group, Inc., 2026 WL 658883 (D. Minn. 2026), the United States District Court for the District of Minnesota examined the boundaries of discovery in a lawsuit challenging an insurer's use of artificial intelligence in Medicare Advantage coverage decisions. The plaintiffs alleged that UnitedHealth's deployment of an AI tool called nH Predict was inconsistent with plan materials that explicitly stated coverage decisions would be made by clinicians. Because this allegation centered on whether the insurer honored its contractual commitments, the court granted discovery into a broad range of operational documents: policies, procedures, governance structures, regulatory oversight, training materials, oversight mechanisms, and vendor relationships — essentially everything that would show how the AI tool functioned in the real world.

At the same time, the court imposed meaningful limits. It denied plaintiffs' requests for certain internal investigations and financial or profitability data that were not sufficiently tied to the contract claims. More significantly, it rejected requests for the AI system's source code, underlying data, and embedded medical guidelines, recognizing that insurers have legitimate interests in protecting proprietary technical information. This distinction — allowing discovery of governance and operational detail while shielding technical architecture — reflects a calibrated approach: the court wanted to test whether the insurer lived up to its promises about human clinical involvement, not to expose the mathematical internals of the algorithm itself.

The court extracted three practical lessons for insurers. First, using AI in claims handling opens the door to broad discovery about implementation, supervision, and real-world use — especially when plaintiffs argue that AI has replaced individualized clinical judgment. Insurers must be able to document and demonstrate that AI serves as a support tool rather than a substitute for required human review. Clear documentation of how AI recommendations are generated, reviewed, and acted upon becomes essential. Second, the language in policy documents and evidence-of-coverage materials is critical. The court's entire analysis hinged on whether UnitedHealth's actual workflow matched its representations about how coverage would be decided. Any gap between what the documents promise and what happens in practice exposes the insurer to litigation and discovery risk. Third, proprietary AI materials may receive protection, but operational and governance-level information will not. Courts will likely shield source code and technical data while still requiring production of documents showing how AI affects claims handling, oversight, and decision-making.

The Lokken decision underscores that courts may scrutinize insurers' use of AI in claims handling and permit broad discovery into operational practices when contractual compliance is at issue. The ruling creates concrete incentives for insurers to align policy language with real-world workflows, maintain robust oversight records, and clearly document the role of human review in AI-assisted decisions — steps that can substantially reduce both litigation risk and the scope of discovery exposure if a claim is filed.

Context & Analysis

The Lokken decision reflects an important tension in how courts balance innovation protection against transparency when AI intersects with contractual obligations. The court's core holding turns on the specificity of UnitedHealth's policy language: because the plan materials promised that coverage decisions would be made by clinicians, the plaintiffs had a plausible claim that the AI tool's deployment violated that promise. This gave them a legitimate reason to probe the insurer's actual workflows, governance, and human oversight — not to reverse-engineer the AI, but to verify whether the contractual obligation was met in practice.

What makes Lokken significant for the insurance industry is that it narrows the scope of "trade secret" protection in AI claims. The court protected code and technical algorithms — the hard intellectual property — but not the operational and governance layers that bridge between algorithm and coverage denial. This distinction reflects a practical recognition: the question of whether a human clinician actually reviewed a denial is not proprietary in the same way the algorithm's weights are. It is a question of process compliance.

Insurers operating under this precedent should read it as a warning that vague or aspirational language about human involvement in their policy documents will create discovery exposure if their actual processes do not match. Clear documentation of oversight, training, and decision-making workflows becomes not just a compliance best practice but a litigation liability hedge. The case suggests that courts will scrutinize AI use in claims handling when contractual promises are involved — and that scrutiny will extend to how the tool is governed and applied, even if the tool's technical internals remain protected.

FAQ

What AI tool was at issue in the Lokken case?
UnitedHealth's nH Predict AI tool, which the company used in Medicare Advantage coverage decisions.
What information was the court willing to protect from discovery?
The court denied requests for the AI system's source code, underlying data, and embedded medical guidelines, recognizing the need to protect proprietary technical information.
What documents did the court require the insurer to produce?
The court allowed discovery into policies, procedures, governance structures, training materials, oversight mechanisms, vendor relationships, and how the AI tool was used in practice — because plaintiffs claimed the tool replaced individualized clinical judgment promised in the contract.

Get the latest AI Safety & Alignment news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime