AIToday
Large Language ModelsAI Safety & AlignmentThe Verge AIPublished: Oct 2, 2026, 22:00 JST

Madison: diners trust ChatGPT over servers on allergies

Madison: diners trust ChatGPT over servers on allergies

3 Key Points

  1. What happened

    A New York City server named Madison says guests with shellfish allergies ordered broth made from shellfish after ChatGPT said it was safe, and dismissed sommeliers in favor of the chatbot.

  2. Why it matters

    If diners act on chatbot answers over staff warnings, allergen guidance and wine service may no longer be treated as authoritative by the people the staff are trying to protect.

  3. What to watch

    The risk hinges on whether guests keep treating chatbot answers as final when staff and maps disagree; watch how food-service and park workers respond as Meta's new AI agent Muse spreads.

WHO IT HITSRestaurant servers, sommeliers, and other front-line service staff are the ones absorbing the pushback when customers arrive with chatbot-generated answers, and river rangers and childcare workers report the same pattern.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The complaints are not limited to a single restaurant or a single industry. Madison's experience with shellfish-allergy guests who trusted ChatGPT is echoed by a river ranger who watched groups stay skeptical while he pointed at a map, and by an after-school teacher whose students' parents insisted a chatbot's sleep schedule was fine. Lauren Wilford, who has worked in food service for 15 years, describes a shift from guests uploading menu photos to chatbots for wine pairings to agents calling and emailing to make reservations on users' behalf.

A common thread in these accounts is that the chatbot's answer is treated as more credible than the person in front of the customer. Madison and her colleagues have learned to soften the correction, telling guests the wine list is unusually specific rather than saying the bot invented a wine brand. The ranger, Jason, describes the same wall: even with a map and a printed guidebook, some groups remained skeptical.

The stakes here are likely highest where the information concerns safety or care, such as an allergen in a broth or a child's sleep. Whether this pattern eases or deepens may depend on how the next generation of AI agents behaves, since Wilford already suspects an agent, not a person, sent demanding last-minute requests for an event.

FAQ
What did the server say customers did when she warned them about allergens?
Madison says guests pushed back, saying ChatGPT disagreed with her. She says one guest with a shellfish allergy ordered a fish dish whose broth was made from shellfish.
Where else are workers seeing this happen?
A river ranger in the Mountain West says visitors arrive with AI-generated itineraries that hallucinated campsites. An after-school teacher in New York says parents insisted ChatGPT's sleep schedule was fine.
What did Lauren Wilford suspect about a demanding client's last-minute requests?
Wilford, who manages a restaurant in Providence, Rhode Island, says a hands-off client suddenly requested podiums and AV equipment before an event. She believes the requests may have come from an AI agent, though she can't prove it.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleMeta to add Naver Map navigation to AI glasses in 2026