Research into how AI can help users understand skin conditions
Google Research examined how AI tools can help non-experts understand skin conditions and decide what to do next. In a large study, AI substantially improved people’s ability to identify possible conditions, but it did not reliably improve the accuracy of recommended next steps. The research therefore argues that dermatology AI should be designed around human decision-making, safety, and clear guidance—not diagnosis alone. ## Why Dermatology AI Needs Human-Centered Research - More than half of adults use the Internet for health information, and about one-third use AI. - People often lack the medical vocabulary needed to search effectively—for example, searching for “red dots on legs” instead of “palpable purpura.” - Google Research has developed dermatology AI models, validated their generalization, and released datasets such as SCIN. - Earlier research found that online tools can improve condition recognition without necessarily helping people choose appropriate next steps. - The researchers emphasize studying how people interpret and act on AI-generated information. ## Large-Scale Evaluation of an AI Information Tool - A JAMA Dermatology study involved 2,345 participants reviewing de-identified skin-condition cases with images and structured medical histories. - Participants were assigned to one of three groups: - **Standard-search control:** Used familiar text-based search tools. - **AI group:** Used a prototype showing 3–7 AI-predicted conditions, textbook images, and information about symptoms and treatments. - **“Wizard of Oz” control:** Used the same interface, but with dermatologist-provided differential diagnoses presented as if generated by AI. - The AI interface increased participants’ willingness to name a condition: - More than 62% attempted a diagnosis with AI. - Only 41% did so using standard search. - Accuracy also improved: - AI users correctly identified a matching condition about 23% of the time. - Standard-search users achieved 8%. - The “perfect-prediction” interface reached 36%, showing that even accurate candidate lists did not make users nearly perfect. - AI users reported greater confidence, satisfaction, and satisfaction with the time spent searching. ## Identifying a Condition Does Not Guarantee Safe Action - The prototype intentionally avoided prescribing actions or making individualized diagnoses. - Treatment information was dermatologist-written and based on the condition name, rather than the severity or details of the specific case. - Choosing the right next step—such as home care, routine care, or urgent evaluation—remained difficult. - Next-step accuracy improved only slightly in the “Wizard of Oz” group, from 60% in the standard-search control to 63.5%. - The standard AI group showed no statistically significant improvement. - AI users were slightly more likely than control participants to recommend a less urgent action than dermatologists would: 30% versus 27%. - These findings show that identifying possible conditions is insufficient without stronger safety-oriented guidance. ## Studying Real Users and Diverse Communities - The researchers also conducted a qualitative study, published at ACM CHI, to examine how people use AI for their own active skin concerns. - The project partnered with Stanford’s Healthcare AI Applied Research Team and the Santa Clara Family Health Plan. - The community included many Medi-Cal users who rely on a healthcare safety net. - Researchers aimed to gather richer feedback than survey-based studies provide by observing real-world use. - Because participants spoke four primary languages, the application was translated into those languages, with multilingual volunteers or staff available to support communication. AI can make dermatology information easier to find and improve recognition of possible conditions, but it should not be treated as a substitute for professional judgment. Future tools should focus equally on urgency assessment, personalized context, uncertainty, and clear recommendations for when to seek medical care.
Read original(opens in new tab)