The effectiveness of chatbots and its difference with usual treatment to reduce the symptoms of depression and anxiety: meta-analysis review
DOI:
https://doi.org/10.61173/ycbvq670Keywords:
chatbots, depression, anxiety, CBT, me-ta-analysisAbstract
The review aims to test the effectiveness of chatbots in treating depression and anxiety through cognitive behavioral therapy within a short duration of treatment. This review also tries to test whether chatbot therapies are similar to usual treatments. The study pooled data from 12 studies. In the random effects model, at the significance level of α = 0.05, chatbot therapies significantly reduce the symptoms of depression and anxiety with a small to moderate effect size. For anxiety groups, the range of summarized standardized mean difference is from -0.39 to -0.1. For depression groups, the interval of a summarized standardized mean difference ranges from -0.36 to -0.08. The difference in effectiveness between chatbot therapies and traditional therapies is minimal. Therefore, chatbot-provided cognitive behavioral therapy shows promise for the future. Three studies with significant heterogeneity were removed. They differ in terms of outdated chatbots, significantly varying durations of treatments, and the special period during which the study was conducted. These implications may suggest that chatbots are undergoing rapid upgrades, so future researchers should keep up with the changes in chatbot technology. The number of related researches is limited, and moral concern should be considered in future researches.
References
Househ, M. (2020). Effectiveness and safety of using chatbots to improve mental health: Systematic review and meta-analysis. Journal of medical Internet research, 22(7), e16021. Anmella, G., Sanabra, M., Primé-Tous, M., Segú, X., Cavero, M., Morilla, I., Grande, I., Ruiz, V., Mas, A., Martín-Villalba,
I., et al. (2023). Vickybot, a chatbot for anxiety-depressive symptoms and work-related burnout in primary care and health care professionals: Development, feasibility, and potential effectiveness studies. Journal of medical Internet research, 25, e43293. Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E.,
Vargas, J., Minkel, J., Parks, A. C., & Zilca, R. (2021). Artificially intelligent chatbots in digital mental health interventions: A review. Expert Review of Medical Devices, 18(sup1), 37–49. Danieli, M., Ciulli, T., Mousavi, S. M., Silvestri, G., Barbato,
S., Di Natale, L., & Riccardi, G. (2022). Assessing the impact of conversational artificial intelligence in the treatment of stress and anxiety in aging adults: Randomized controlled trial. JMIR mental health, 9(9), e38067.
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017). Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (woebot): A randomized controlled trial. JMIR mental health, 4(2), e7785. Greer, S., Ramo, D., Chang, Y.-J., Fu, M., Moskowitz, J.,
Haritatos, J., et al. (2019). Use of the chatbot “vivibot” to deliver positive psychology skills and promote well-being among young people after cancer treatment: Randomized controlled feasibility trial. JMIR mHealth and uHealth, 7(10), e15018. Gut,u, S., Cosmoiu, A., Cojocaru, D., Turturescu, T., Popoviciu,
C., & Giosan, C. (2021). Bot to the rescue? effects of a fully automated conversational agent on anxiety and depression: A randomized controlled trial. Ann Depress Anxiety, 8(1), 1107. He, Y., Yang, L., Zhu, X., Wu, B., Zhang, S., Qian, C., & Tian, T. (2022). Mental health chatbot for young adults with depressive symptoms during the covid-19 pandemic: Single-blind, threearm randomized controlled trial. Journal of medical Internet research, 24(11), e40719.
Higgins, J. P., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in medicine, 21(11), 1539–1558. Karkosz, S., Szyman´ski, R., Sanna, K., Michałowski, J., et al. (2024). Effectiveness of a web-based and mobile therapy chatbot on anxiety and depressive symptoms in subclinical young adults: Randomized controlled trial. JMIR formative research, 8(1), e47960. Klos, M. C., Escoredo, M., Joerin, A., Lemos, V. N., Rauws, M., & Bunge, E. L. (2021). Artificial intelligence–based chatbot for anxiety and depression in university students: Pilot randomized controlled trial. JMIR formative research, 5(8), e20678. Kumar, L. M., Stephen, J., George, R., Harikrishna, G., &
Anisha, P. (2022). Use of effect size in medical research: A brief primer on its why and how. Kerala Journal of Psychiatry, 35(1), 78–82.
Lin, L., & Chu, H. (2018). Quantifying publication bias in metaanalysis. Biometrics, 74(3), 785–794.
Liu, H., Peng, H., Song, X., Xu, C., & Zhang, M. (2022). Using ai chatbots to provide self-help depression interventions for university students: A randomized trial of effectiveness. Internet Interventions, 27, 100495. Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg,
D., Herzog, W., & Herzberg, P. Y. (2008). Validation and standardization of the generalized anxiety disorder screener (gad-7) in the general population. Medical care, 46(3), 266–274.
MacNeill, A. L., Doucet, S., & Luke, A. (2024). Effectiveness of a mental health chatbot for people with chronic diseases: Dean&Francis ISSN 2959-6122 Randomized controlled trial. JMIR Formative Research, 8, e50025. Nicol, G., Wang, R., Graham, S., Dodd, S., Garbutt, J., et al. (2022). Chatbot-delivered cognitive behavioral therapy in adolescents with depression and anxiety during the covid-19 pandemic: Feasibility and acceptability study. JMIR Formative Research, 6(11), e40242. Olawade, D. B., Wada, O. Z., Odetayo, A., David-Olawade, A.
C., Asaolu, F., & Eberhardt, J. (2024). Enhancing mental health with artificial intelligence: Current trends and future prospects. Journal of Medicine, Surgery, and Public Health, 3, 100099. https://doi.org/https://doi.org/10.1016/j.glmedi.2024.100099
Patel, F., Thakore, R., Nandwani, I., & Bharti, S. K. (2019). Combating depression in students using an intelligent chatbot: A cognitive behavioral therapy. 2019 IEEE 16th India Council International Conference (INDICON), 1–4. Sadeh-Sharvit, S., Camp, T. D., Horton, S. E., Hefner, J. D.,
Berry, J. M., Grossman, E., & Hollon, S. D. (2023). Effects of an artificial intelligence platform for behavioral interventions on depression and anxiety symptoms: Randomized clinical trial. Journal of Medical Internet Research, 25, e46781. Suharwardy, S., Ramachandran, M., Leonard, S. A., Gunaseelan,
A., Lyell, D. J., Darcy, A., Robinson, A., & Judy, A. (2023). Feasibility and impact of a mental health chatbot on postpartum mental health: A randomized controlled trial. AJOG global reports, 3(3), 100165.
Sun, Y., Fu, Z., Bo, Q., Mao, Z., Ma, X., & Wang, C. (2020). The reliability and validity of phq-9 in patients with major depressive disorder in psychiatric hospital. BMC psychiatry, 20, 1–7.
Ulrich, S., Lienhard, N., Künzli, H., & Kowatsch, T. (2024). A chatbot-delivered stress management coaching for students (misha app): Pilot randomized controlled trial. JMIR mHealth and uHealth, 12, e54945. Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S., & Torous, J. B. (2019). Chatbots and conversational agents in mental health: A review of the psychiatric landscape. The Canadian Journal of Psychiatry, 64(7), 456–464.
WHO. (2023a). Anxiety disorders. https://www.who.int/news-room/fact-sheets/detail/anxiety-
disorders WHO. (2023b). Depressive disorder. https://www.who.int/news-room/fact-sheets/detail/depression
Young, A. S., Klap, R., Shoai, R., & Wells, K. B. (2008). Persistent depression and anxiety in the united states: Prevalence and quality of care. Psychiatric Services, 59(12), 1391–1398.
Zhong, W., Luo, J., & Zhang, H. (2024). The therapeutic effectiveness of artificial intelligence-based chatbots in alleviation of depressive and anxiety symptoms in short-course treatments: A systematic review and meta-analysis. Journal of Affective Disorders.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 by the authors.
This work is licensed under a Creative Commons Attribution 4.0 International License.
