B Evidence Grade B Graded accuracy verified by the review judge Safe to Cite Current

49.6%

49.6% -- problematic response rate for general-purpose consumer chatbots answering medical questions (2026)

2026  · BMJ Open

49.6% of responses from five general-purpose consumer chatbots to medical questions were found to be problematic in an audit.

  • Tested free-tier general assistants under adversarial prompting
Cite this stat Share How we verify
Attribution: BMJ Open View source
Lighthouse Research Team
Last verified:  ·  How we verify data →
Source verified Evidence graded
Value
49.6%
Unit
Percentage
Data Vintage
2026
Entity
general-purpose consumer chatbots answering medical questions
B
Strong, reliable evidence

Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.

61/100 confidence

Single source - not yet corroborated

Extraction
95
Source Trust
60
Citation Chain
20
Independence
30
Methodology
60
Freshness
95
BMJ Open Primary Tier A
https://alhena.ai/blog/ai-roi-health-wellness-ecommerce/ ↗
Confidence: 59/100 Vintage: 2026 Channel: Common Crawl
Source Article
How to Measure AI Shopping Agents in Wellness
Original Research
BMJ Open · Original study ↗

Audit published in BMJ Open, 2026

Methodology documented
Industrymarketing
Plain Text
general-purpose consumer chatbots answering medical questions: 49.6% problematic response rate. Source: BMJ Open (2026). Via Lighthouse Intelligence -- https://lighthousedata.io/data/bmj-chatbot-medical-answers-49-6
HTML Embed
<blockquote cite="https://lighthousedata.io/data/bmj-chatbot-medical-answers-49-6" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>49.6%</strong> -- problematic response rate for general-purpose consumer chatbots answering medical questions<br><small>Source: BMJ Open (2026) · <a href="https://lighthousedata.io/data/bmj-chatbot-medical-answers-49-6" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Share on X Share on LinkedIn

Use this data in your work

Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.

Copy citation Explore similar stats →