Navigating healthier beverage consumption in adolescents using the "R-Ma Bot" chatbot: A usability and evaluation study

Abstract

Objective This pilot study aimed to evaluate the usability and effectiveness of a behavior change technique (BCT)-based chatbot developed to promote healthier beverage consumption among adolescents.Methods The Read and Manage your health roBot ("R-Ma Bot"), designed with 13 BCTs, was tested with 42 adolescents (13 men, 29 women, mean age 15.0 +/- 0.7) for 2 weeks. Usability was assessed after the 2-week intervention using a chatbot usability questionnaire, recruitment, retention, participation, and engagement. Scores above 70 out of 100 were considered high usability. Qualitative data from open-ended questions were collected for evaluation. Effectiveness was measured by changes in knowledge, use and impact of nutrition labels, and weekly consumption of sugar, sodium, and caffeine from carbonated and/or energy drinks before and after the 2-week intervention.Results The score of R-Ma Bot's usability averaged 74.7, with participants addressing it useful, friendly, and easy to use, though they suggested improving unnatural conversation flow. All participants engaged with the chatbot for at least 13 out of 14 days, with over half using it daily for the entire period. After intervention, awareness of nutrition labels increased from 64.3% to 92.9%, and nonreaders decreased from 42.9% to 16.7%. Weekly sugar intake from beverages significantly decreased by 60%, from 13.1 +/- 20.1 mg to 7.9 +/- 12.8 mg.Conclusions R-Ma Bot's high usability contributed to high retention and behavioral changes, significantly reduced sugar consumption from beverages and improved awareness of nutrition labels. We suggest integrating strategies that enhance knowledge, motivation, and opportunities through BCTs with youth-friendly design elements in the development of interventions for adolescents.