Healthcare chatbot apps represent potentially billions in savings for healthcare providers but trust and usability remain a factor

SAN FRANCISCO, Calif – January 16, 2019 – The healthcare industry is in the midst of a technological transformation. The adoption of chatbot apps are changing the way consumers seek medical treatment and the way in which the healthcare industry is connecting with consumers. However, despite their potential, healthcare chatbot apps face several challenges before widespread adoption is achieved.

To gain a better understanding of the current levels of satisfaction and usability with some of the leading healthcare chatbot apps, UserTesting, the leading on-demand human insight platform, today announced the findings of the Healthcare Chatbot Customer Experience (CX) Index Report. The report ran a competitive benchmarking study of five of the top healthcare chatbot apps: Ada, HealthTap, Mediktor, Your.MD and Symptomate.

The report consisted of 500 consumers that evaluated the chatbot apps based on the following criteria: Ease of Use, Speed, Credibility, Aesthetics, and Delight. UserTesting identified these criteria as key customer attributes based on more than 10 years of experience helping companies leverage human insight to improve customer experiences.

Key findings from this report:

  • Chatbot apps still need to earn customer trust. Participants in this report noted unease in trusting unfamiliar brands with their personal information as well as the lack of HIPAA (Health Insurance Portability and Accountability Act) compliance with many chatbot apps.

  • Chatbot apps do a poor job of handling complex conditions. All of the apps were inconsistent at best when diagnosing complex conditions. Some of the simplest symptoms tested would often lead to alarming and inaccurate diagnoses.

  • Basic usability issues detracted from the overall chatbot experience. Loading issues for some participants, for example, made some chatbot apps unusable at times. Chatbot apps with a poor CX may lose potential users, revenue or worse.

“Consumers have high expectations when it comes to their digital experiences. From ordering a car ride to managing finances to getting medical advice, consumers expect a fast, easy and high-quality customer experience,” said Janelle Estes, Chief Insights Officer at UserTesting. “Our study shows the importance of leveraging human insight to understand consumer sentiment and preference in order to create a superior customer experience – it can ultimately determine success or failure for next-gen apps like chatbots and conversational AI.”

To access the Healthcare Chatbot Customer Experience (CX) Index Report click here. To review UserTesting’s past industry CX reports, visit here.

Research Methodology

Five hundred consumers evaluated the apps based on five factors—Ease of Use, Speed, Credibility, Aesthetics, and Delight—which UserTesting has identified as the key customer experience attributes over more than 10 years of helping companies leverage human insight to improve their customer experiences. Participants were given a list of symptoms for the common cold, and for food poisoning, and were asked to use the apps to get a diagnosis. Participants then answered a series of questions about their experience, which resulted in both quantitative data (a UserTesting “UQ” score on a scale of 0 “negative” to 100 “positive”) and qualitative insights.

About UserTesting
UserTesting (NYSE: USER) has fundamentally changed the way organizations get insights from customers with fast, opt-in feedback and experience capture technology. The UserTesting Human Insight Platform taps into our global network of real people and generates video-based recorded experiences, so anyone in an organization can directly ask questions, hear what users say, see what they mean, and understand what it’s actually like to be a customer. Unlike approaches that track user behavior then try to infer what that behavior means, UserTesting eliminates the guesswork and brings customer experience data to life with human insight. UserTesting has more than 2,100 customers, including more than half of the world’s top 100 most valuable brands according to Forbes. UserTesting is headquartered in San Francisco, Calif. To learn more, visit

Media Contacts:
UserTesting, Inc.
Chris Halcon

Investor Relations Contact:
Sapphire Investor Relations, LLC
Erica Mannion and Michael Funari