
Kinney Drugs, a Vermont pharmacy chain, has scaled back its AI assistant Burt after hundreds of customers reported problems including incoherent calls, incorrect dosages, and missed notifications.
Though the assistant meets HIPAA privacy requirements, the company decided the user experience fell short and will return to a traditional touch-tone phone system for incoming calls while keeping Burt for opt-in outbound text messages about prescription refills.
What happened
Kinney Drugs is pulling back its AI assistant Burt, which the Vermont pharmacy chain introduced in May to handle prescription calls and refills. Customers reported incoherent calls, wrong dosages, and missed prescription notifications. The company will return incoming patient calls to a touch-tone phone system, though Burt will continue handling outbound prescription refill texts with customer opt-in.
Why it matters
The rollback highlights the gap between technical compliance and user experience in healthcare AI. President John Marraffa acknowledged the company "did not" get the experience right, despite Burt meeting HIPAA privacy standards. Patients' trust in AI-assisted healthcare depends not just on security, but on reliability — a lesson relevant to any business deploying AI to handle sensitive customer interactions.
What to watch
Kinney Drugs will retain Burt for outbound text notifications (prescription refills) but only to customers who explicitly opt in. The company's pivot from inbound to outbound, combined with opt-in requirements, reflects how businesses may need to reset customer expectations around AI in regulated industries.
Kinney Drugs, a pharmacy chain based in Vermont, introduced Burt, an AI assistant named after the chain's founder, in May. Burt's initial purpose was to communicate with patients about prescriptions and refills via inbound phone calls. Within weeks, however, customers began reporting significant problems. According to VTDigger's reporting, complaints included incoherent calls, dosage errors, and missed prescription notifications—issues that struck at the core reliability pharmacy customers depend on.
The company initially defended Burt on privacy and security grounds. Kinney Drugs President John Marraffa noted that Burt is fully HIPAA compliant, not open-source, and does not generate or manipulate data. However, Marraffa acknowledged in a public statement that compliance with privacy standards does not equal a good user experience: "But one thing I want to point out is getting privacy and security right does not mean we got the experience right. We did not, and we own that." This admission prompted the decision to scale back.
Effective immediately, Kinney Drugs is returning all incoming patient calls to the classic touch-tone phone system. Burt will not be retired entirely; instead, it will handle only outbound communications—specifically prescription refill notifications sent via text message. Crucially, these messages will only go to customers who opt in, placing control back in the customer's hands and reducing the risk of forced interaction with a system that failed to meet expectations.
Kinney Drugs' decision to roll back Burt underscores a persistent challenge in AI deployment: technical correctness does not guarantee user satisfaction. The assistant met HIPAA compliance standards and did not expose health data through an open-source system, yet customers experienced failures in the core tasks—accurate dosage communication, reliable notifications, and clear phone interactions. President John Marraffa's public acknowledgment that the company "did not" get the experience right signals a shift in how pharmacy leadership now evaluates AI: security and privacy are table stakes, not a sufficient condition for launch or continuation.
The move to retain Burt only for opt-in outbound messages reflects a narrower, lower-stakes use case. Text notifications about prescription refills are less time-sensitive and less likely to cause harm if miscommunicated than inbound pharmacy calls about dosages or refill status. By requiring explicit opt-in, Kinney Drugs also transfers decision-making back to the customer—a practical hedge against future complaints.
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytime
Ask AI anything about this article. Q&As are published on this page for other readers too.
Amazon and Google are intensifying competitive efforts against The Trade Desk (TTD), a major digital advertisi…

Novo Nordisk has entered a strategic partnership with Amazon Web Services (AWS) to accelerate drug discovery u…

OpenAI introduced Premium Seats for ChatGPT Business, priced at $125 per user per month ($100 with annual bill…

Computer scientists at University of Tübingen, Max Planck Institute, MATS Research, and Snyk discovered a meth…

Anthropic pledged to embed machine-readable watermarks in Claude-generated text and digitally signed provenanc…

Anthropic has signed the EU AI Act Code of Practice and will embed invisible watermarks in Claude-generated te…

The AI news that matters, in one minute each morning.
Sign up free