B
Evidence Grade B
Graded
accuracy verified by the review judge
Safe to Cite
Current
49.6%
49.6% -- problematic response rate for General chatbots (medical questions) (2026)
49.6% of responses from five general-purpose consumer chatbots to medical questions were found to be problematic in a 2026 BMJ Open audit.
- Tested free-tier general assistants under adversarial prompting, which may overstate real-world error rates compared to domain-restricted grounded commerce agents
Attribution:
View source
Lighthouse Research Team
Last verified:
·
How we verify data →
Source verified
Evidence graded
Value
49.6%
Unit
Percentage
Data Vintage
2026
Entity
Evidence Quality
B
Strong, reliable evidence
Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.
Single source - not yet corroborated
Score breakdown
Extraction
75
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Source
BMJ Open
Primary
Tier B
https://alhena.ai/blog/ai-roi-health-wellness-ecommerce/ ↗
Source Article
How to Measure AI Shopping Agents in Wellness
Original Research
BMJ Open
· Original study ↗
Methodology
BMJ Open audit of chatbot responses to medical questions
Methodology documented
Segmentation
Industrymarketing
Cite this stat
Plain Text
General chatbots (medical questions): 49.6% problematic response rate. Source: BMJ Open (2026). Via Lighthouse Intelligence -- https://lighthousedata.io/data/bmj-chatbot-problematic-responses-2026
HTML Embed
<blockquote cite="https://lighthousedata.io/data/bmj-chatbot-problematic-responses-2026" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>49.6%</strong> -- problematic response rate for General chatbots (medical questions)<br><small>Source: BMJ Open (2026) · <a href="https://lighthousedata.io/data/bmj-chatbot-problematic-responses-2026" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Related Statistics
Use this data in your work
Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.