Mooditor: An AI-Powered Mobile Assistant for Real-Time, Emotion-Aware Mental-Health Support

English

Authors

  • Laila HAMZA Laboratory of Information Technologies (LTI), National School of Applied Sciences (ENSA), Chouaïb Doukkali University, El Jadida, Morocco
  • Salma CHAJARI IITE, National School of Applied Sciences, Chouaib Doukkali University, El Jadida, Morocco
  • Niama SAKHIR IITE, National School of Applied Sciences, Chouaib Doukkali University, El Jadida, Morocco
  • Rahhal ERRATTAHI LTI, National School of Applied Sciences, Chouaib Doukkali University, El Jadida, Morocco

Keywords:

Mental Health, Emotion Recognition, Real-Time Analysis, Chatbot Integration, AI-Powered Healthcare

Abstract

Mooditor is a pioneering mobile and web-based application designed to enhance mental health monitoring through artificial intelligence. By integrating real-time emotion detection via facial expression analysis and a Rasa-powered chatbot for therapeutic interactions, Mooditor provides a multi-modal approach to mental well-being. The system leverages computer vision and natural language processing (NLP) to assess psychological states, offering continuous monitoring and personalized support. Comprehensive tools, including mood tracking, statistical analysis, and conversation history, enable users and healthcare professionals to track emotional trends effectively. Our evaluation demonstrates exceptional performance, with the emotion detection model achieving a macro average precision, recall, and F1-score of 0.9998 across 953 instances. Mooditor’s modular architecture supports future enhancements, such as advanced emotion detection algorithms and integration with professional mental health services. This work addresses critical challenges in mental health accessibility and early intervention, contributing to the advancement of digital mental health care.

Downloads

Download data is not yet available.

References

D. Vigo, G. Thornicroft et R. Atun, “Estimating the true global burden of mental illness,” Lancet Psychiatry, vol. 3, pp. 171–178, 2016.

D. V. Jeste, E. E. Lee et S. Cacioppo, “Battling the modern behavioral epidemic of loneliness: Suggestions for research and interventions,” JAMA Psychiatry, vol. 77, pp. 553–554, 2020.

E. Iob, P. Frank, A. Steptoe et D. Fancourt, “Levels of severity of depressive symptoms among at-risk groups in the UK during the COVID-19 pandemic,” JAMA Network Open, vol. 3, p. e2026064, 2020.

A. Satiani, J. Niedermier, B. Satiani et D. P. Svendsen, “Projected workforce of psychiatrists in the United States : A population-based analysis,” Psychiatric Services, vol. 69, no 6, pp. 710–713, 2018.

W. L. Bi, A. Hosny, M. B. Schabath et al., “Artificial intelligence in cancer imaging : Clinical challenges and applications,” CA Cancer J Clin, vol. 69, pp. 127–157, 2019.

G. A. Zakhem, J. W. Fakhoury, C. C. Motosko et R. S. Ho, “Characterizing the role of dermatologists in developing artificial intelligence for assessment of skin cancer : A systematic review,” J Am Acad Dermatol, 2020. Published en ligne le 20 janv.

E. J. Topol, “High-performance medicine : The convergence of human and artificial intelligence,” Nature Medicine, vol. 25, no 1, pp. 44–56, 2019.

P. Cecula et al., “AI in the field of mental health : Growth and future outlook,” Journal of AI Research in Medicine, 2021.

K. Ćosić et al., “Using AI for treatment planning in mental health : Perspectives and challenges,” Mental Health Informatics, 2020.

A. Johnson et al., “Predictive AI models for mental health interventions,” Frontiers in Psychiatry, 2021.

S. Goldberg et al., “AI speech analysis in therapy sessions : A new frontier,” Journal of Affective Computing, 2020.

A. Bohr et K. Memarzadeh, “Continuous patient monitoring using AI in mental healthcare,” Healthcare AI Review, 2020.

T. Davenport et al., “Mental health consequences of COVID-19 : Emerging insights,” Psychological Services, 2020.

J. Latoo et al., “Pandemic-induced mental distress : Lessons learned,” International Journal of Mental Health, 2021.

C. Moreno et al., “Global mental health impacts of the COVID-19 pandemic,” World Psychiatry, 2020.

S. Graham, C. Depp, D. V. J. Lee, C. Nebeker, X. Tu, H.-C. Kim et D. V. Jeste, “Artificial intelligence for mental health and mental illnesses : An overview,” Current Psychiatry Reports, vol. 21, no 11, pp. 1–18, 2019.

L. Bickman, “Scalable mental health interventions using AI : Review and future directions,” Psychiatric Services, 2020.

N. Koutsouleris et al., “AI-based adaptive interventions in psychiatry,” Journal of Digital Health, 2022.

M. Milne-Ives, E. Selby, B. Inkster et al., “Artificial intelligence and machine learning in mobile apps for mental health : a scoping review,” PLOS Digit Health, vol. 1, p. e0000079, 2022.

D. R. King, G. Nanda, J. Stoddard et al., “An introduction to generative artificial intelligence in mental health care : considerations and guidance,” Current Psychiatry Reports, vol. 25, pp. 839–846, 2023.

K.-W. Jin, Q. Li, Y. Xie et al., “Artificial intelligence in mental healthcare : an overview and future perspectives,” Br J Radiol, vol. 96, p. 20230213, 2023.

S. D’Alfonso, O. Santesteban-Echarri, S. Rice et al., “Artificial intelligence-assisted online social therapy for youth mental health,” Front Psychol, vol. 8, p. 96, 2017.

R. Tornero-Costa, A. Martinez-Millana, N. Azzopardi-Muscat et al., “Methodological and quality flaws in the use of artificial intelligence in mental health research : systematic review,” JMIR Ment Health, vol. 10, p. e42045, 2023.

B. G. Buchanan, “A (very) brief history of artificial intelligence,” AI Magazine, vol. 26, no 4, pp. 53–60, 2005.

J. H. Moor, “The Dartmouth college artificial intelligence conference : the next fifty years,” AI Magazine, vol. 27, no 4, p. 87, 2006.

S. Russell et P. Norvig, Artificial Intelligence : A Modern Approach, 4ᵉ éd., Pearson, 2021.

I. Goldstein et S. Papert, “Artificial intelligence, language, and the study of knowledge,” Cognitive Science, vol. 1, no 1, pp. 84–123, 1977.

J. Weizenbaum, “ELIZA — A computer program for the study of natural language communication between man and machine,” Communications of the ACM, vol. 9, no 1, pp. 36–45, 1966.

C. Bassett, “The computational therapeutic : exploring Weizenbaum’s ELIZA as a history of the present,” AI & Society, vol. 34, no 4, pp. 803–812, 2018.

D. D. Luxton, “Artificial intelligence in psychological practice : current and future applications and implications,” Professional Psychology : Research and Practice, vol. 45, no 4, pp. 332–339, 2014.

S. Zhou, J. Zhao et L. Zhang, “Application of artificial intelligence on psychological interventions and diagnosis : an overview,” Frontiers in Psychiatry, vol. 13, p. 811665, 2021.

E. E. Lee, J. Torous, M. De Choudhury et al., “Artificial intelligence for mental healthcare : clinical applications, barriers, facilitators, and artificial wisdom,” Biological Psychiatry : Cognitive Neuroscience and Neuroimaging, vol. 6, no 9, pp. 856–864, 2021.

F. Minerva et A. Giubilini, “Is AI the future of mental healthcare ?,” Topoi, vol. 42, no 3, pp. 809–817, 2023.

K. B. Johnson, W. Wei, D. Weeraratne et al., “Precision medicine, AI, and the future of personalized health care,” Clinical Translational Science, vol. 14, no 1, pp. 86–103, 2021.

J. Chen, N. Y. Chan, C.-T. Li, J. W. Y. Chan, Y. Liu, S. Li et Y.-K. Wing, “Multimodal digital assessment of depression with actigraphy and app in healthcare,” Translational Psychiatry, vol. 14, no 1, p. 150, 2024.

A. K. Das et R. Naskar, “A deep learning model for depression detection based on MFCC and CNN generated spectrogram features,” Biomedical Signal Processing and Control, vol. 90, p. 105898, 2024.

E. Maekawa, E. M. Grua, C. A. Nakamura, M. Scazufca, R. Araya, T. Peters et P. Van De Ven, “Bayesian networks for prescreening in depression : algorithm development and validation,” JMIR Mental Health, vol. 11, p. e52045, 2024.

J. H. Yang, Y. Chung, S. J. Rhee, K. Park, M. J. Kim, H. Lee et Y. M. Ahn, “Development and external validation of a logistic and penalized logistic model using machine-learning techniques to predict suicide attempts : A multicenter prospective cohort study in Korea,” Journal of Psychiatric Research, vol. 176, pp. 442–451, 2024.

S. R. Susai, D. Mongan, C. Healy, M. Cannon, G. Cagney, K. Wynne et D. Cotter, “Machine learning based prediction and the influence of complement–coagulation pathway proteins on clinical outcome : Results from the NEURAPRO trial,” Brain, Behavior, and Immunity, vol. 103, pp. 50–60, 2022.

S. Andersson, D. R. Bathula, S. I. Iliadis, M. Walter et A. Skalkidou, “Predicting women with depressive symptoms postpartum with machine learning methods,” Scientific Reports, vol. 11, no 1, p. 7877, 2021.

R. Redlich, J. J. Almeida, D. Grotegerd et al., “Brain morphometric biomarkers distinguishing unipolar and bipolar depression : a voxel-based morphometry—pattern classification approach,” JAMA Psychiatry, vol. 71, pp. 1222–1230, 2014.

B. A. Clementz, J. A. Sweeney, J. P. Hamm et al., “Identification of distinct psychosis biotypes using brain-based biomarkers,” American Journal of Psychiatry, vol. 173, pp. 373–384, 2016.

A. G. Reece et C. M. Danforth, “Instagram photos reveal predictive markers of depression,” EPJ Data Science, vol. 6, p. 15, 2017.

I. C. Passos et B. Mwangi, “Machine learning-guided intervention trials to predict treatment response at an individual patient level : An important second step following randomized clinical trials,” Molecular Psychiatry, vol. 25, pp. 701–702, 2020.

A. Etkin, B. Patenaude, Y. J. C. Song, T. Usherwood, W. Rekshan, A. F. Schatzberg et al., “A cognitive-emotional biomarker for predicting remission with antidepressant medications : A report from the iSPOT-D trial,” Neuropsychopharmacology, vol. 40, pp. 1332–1342, 2015.

A. Khodayari-Rostamabad, J. P. Reilly, G. M. Hasey, H. de Bruin et D. J. MacCrimmon, “A machine learning approach using EEG data to predict response to SSRI treatment for major depressive disorder,” Clinical Neurophysiology, vol. 124, pp. 1975–1985, 2013.

T. M. Ball, M. B. Stein, H. J. Ramsawh, L. Campbell-Sills et M. P. Paulus, “Single-subject anxiety treatment outcome prediction using functional neuroimaging,” Neuropsychopharmacology, vol. 39, pp. 1254–1261, 2014.

A. Hasan, T. Wobrock, B. Guse, B. Langguth, M. Landgrebe, P. Eichhammer et al., “Structural brain changes are associated with response of negative symptoms to prefrontal repetitive transcranial magnetic stimulation in patients with schizophrenia,” Molecular Psychiatry, vol. 22, pp. 857–864, 2017.

G. M. Lucas, J. Gratch, A. King et L.-P. Morency, “It’s only a computer : Virtual humans increase willingness to disclose,” Computers in Human Behavior, vol. 37, pp. 94–100, 2014.

S. Gerke, T. Minssen et G. Cohen, “Ethical and legal challenges of artificial intelligence-driven healthcare,” dans Artificial Intelligence in Healthcare, pp. 295–336, Elsevier, 2020.

N. Naik, B. M. Z. Hameed, D. K. Shetty et al., “Legal and ethical consideration in artificial intelligence in healthcare : who takes responsibility ?,” Frontiers in Surgery, vol. 9, p. 862322, 2022.

S. Bouhouita-Guermech, P. Gogognon et J.-C. Bélisle-Pipon, “Specific challenges posed by artificial intelligence in research ethics,” Frontiers in Artificial Intelligence, vol. 6, p. 1149082, 2023.

M. C. T. Tai, “The impact of artificial intelligence on human society and bioethics,” Tzu Chi Medical Journal, vol. 32, no 4, pp. 339–343, 2020.

K. K. Fitzpatrick, A. Darcy et M. Vierhile, “Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot) : A randomized controlled trial,” JMIR Mental Health, vol. 4, no 2, p. e19, 2017.

G. Cruz-Gonzalez, E. E. Lee, J. Torous et D. V. Jeste, “Challenges and opportunities in multimodal AI for mental health monitoring,” Psychological Medicine, vol. 55, no 4, pp. 672–680, 2025.

A. Fadhil et al., “Telemedicine chatbots for elderly care,” HealthTech Journal, 2018.

S. Divya et al., “NLP and pattern matching for chatbot diagnosis,” International Journal of Computer Applications, 2018.

A. Rafla et al., “Rasa chatbot optimization using TensorFlow,” AI Research Journal, 2019.

R. B. Mathew et al., “NLP and KNN-based chatbot for medical support,” dans International Conference on AI in Healthcare, 2019.

S. Ayanouz et al., “Speech-enabled NLP chatbot for healthcare,” Computational Linguistics Today, 2020.

Sophia et al., “Symptom recognition chatbot using AIML,” Journal of NLP Applications, 2020.

A. Ul Hussna et al., “Adaptive chatbot for knowledge base expansion,” AI and Society, 2020.

C. Bulla, A. Shetty et V. Kalva, “A review of AI-based medical assistant chatbots,” Research and Applications of Web Development and Design, vol. 3, no 2, 2020.

K. Achtaich et al., “Transfer learning in multi-agent health chatbots,” Applied Intelligence, 2021.

T. Sharma et al., “Decision tree based mental health chatbot,” dans IEEE Xplore, 2021.

T. N. T. Mai et M. Shcherbakov, “Enhancing Rasa NLU model for Vietnamese chatbot,” International Journal of Open Information Technologies, vol. 9, no 1, pp. 31–36, 2021.

I. Salhi, N. Jebara, M. K. Hmimida et A. Mahfoudhi, “Towards developing a pocket therapist : an intelligent adaptive psychological support chatbot against mental health disorders in a pandemic situation,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 23, no 2, pp. 1200–1211, 2021.

J. P. Gujjar et V. N. Kumar, “Open source chatbot development framework – RASA,” Asian Journal of Advanced Research, vol. 5, no 1, pp. 451–453, 2022.

Hugging Face, “Emotion models collection : Comprehensive repository of pre-trained emotion detection models,” 2023. https://huggingface.co/models

N. Kumari et R. Bhatia, “Efficient facial emotion recognition model using deep convolutional neural network and modified joint trilateral filter,” Soft Computing, vol. 26, no 16, pp. 7817–7830, 2022.

F. M. Alamgir et M. S. Alam, “An artificial intelligence driven facial emotion recognition system using hybrid deep belief rain optimization,” Multimedia Tools and Applications, vol. 82, no 2, pp. 2437–2464, 2023.

A. A. Abd-Alrazaq et al., “Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being,” npj Digital Medicine, vol. 6, p. 236, 2023.

S. Kasaudhan, “Artificial intelligence in mental health : A review of applications and challenges in digital health solutions,” International Journal of Preventive Medicine and Health, vol. 5, no 3, pp. 23–28, 2025.

S. Shetty, P. Shetty, A. S. Hegde, K. P. Swamy et S. K. Shetty, “Mental health monitoring using AI-based smartphone applications,” Healthcare Technology Letters, vol. 12, no 2, pp. 34–39, 2025.

D. B. Olawade, O. J. Wale, T. A. David et O. A. Adegbenjo, “Enhancing mental health with artificial intelligence : Current trends and future prospects,” Journal of Medicine, Surgery, and Public Health, vol. 2, p. 100099, 2024.

Y. LeCun, Y. Bengio et G. Hinton, “Deep learning,” Nature, vol. 521, no 7553, pp. 436–444, 2015.

Downloads

Published

2025-06-30

How to Cite

[1]
L. HAMZA, S. CHAJARI, N. SAKHIR, and R. ERRATTAHI, “Mooditor: An AI-Powered Mobile Assistant for Real-Time, Emotion-Aware Mental-Health Support: English”, IJCEDS, vol. 4, no. 2, pp. 10–21, Jun. 2025.

Issue

Vol. 4 No. 2 (2025): Volume 4. Issue 2

Section

Original Software Publication

ARK

https://n2t.net/ark:/32155/IJCEDS.v4i2.89

License

Copyright (c) 2025 Laila HAMZA, Salma CHAJARI, Niama SAKHIR, Rahhal ERRATTAHI

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Copyright on any article published in the International Journal of Computer Engineering and Data Science (IJCEDS) is retained by the author(s). All articles are published under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0), which permits any non-commercial use, distribution, and reproduction in any medium, provided that the original work is properly cited.

License Agreement

By submitting and publishing their work in IJCEDS, the authors:

  • Grant IJCEDS the non-exclusive right to publish the article and to identify IJCEDS as the original publisher.

  • Authorize any third party to use, share, and reproduce the article for non-commercial purposes, provided that appropriate credit is given to the original authors and source, and a link to the license is included.