Continuous Behavioral State Modeling via HMM for Adherence Recognition in Psychoeducational Intervention Processes
Main Article Content
Abstract
Current compliance identification methods in psychoeducational interventions often rely on discrete retrospective assessment and cannot dynamically capture continuous state evolution. To address this limitation, this paper proposes a continuous behavioral state modeling method based on the Hidden Markov Model. Real-time user interaction behavior sequences are collected through a digital intervention platform and used as observation data. Potential internal compliance states are defined according to psychoeducational theory, and the probabilistic relationship between observed sequences and latent states is modeled using HMM. Through parameter learning of state transition and observation probabilities and decoding algorithms, the user’s real-time compliance state sequence is dynamically inferred, enabling continuous and automated tracking of compliance levels. Experimental results show that the proposed method is highly consistent with expert annotations in identifying turning points, achieving a state sequence alignment accuracy of 0.833, outperforming random forest and rule-based methods. For early warning, the model detects “significantly decreased compliance” and “intervention dropout” events 12.5 and 18.2 days earlier on average, with recall of 0.900 and AUC of 0.892.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
P. Musiat, C. Johnson, M. Atkinson, et al., “Impact of guidance on intervention adherence in computerised interventions for mental health problems: a meta-analysis,” Psychological medicine, vol. 52, no. 2, pp. 229-240, 2022, doi: 10.1017/S0033291721004621.
P. Harmanci and K. Budak F, “The effect of psychoeducation based on motivational interview techniques on medication adherence, hope, and psychological well-being in schizophrenia patients,” Clinical Nursing Research, vol. 31, no. 2, pp. 202-216, 2022, doi: 10.1177/10547738211046438.
M. Liu and M. Schueller S, “Moving evidence-based mental health interventions into practice: implementation of digital mental health interventions,” Current treatment options in psychiatry, vol. 10, no. 4, pp. 333-345, 2023, doi: 10.1007/s40501-023-00298-2.
G. Woolley M, S. Klimczak K, H. Davis C, et al., “Predictors of adherence to a publicly available self-guided digital mental health intervention,” Cognitive behaviour therapy, vol. 53, no. 6, pp. 577-591, 2024, doi: 10.1080/16506073.2024.2341807.
R. Maqsood, P. Ceravolo, C. Romero, et al., “Modeling and predicting students’ engagement behaviors using mixture Markov models,” Knowledge and Information Systems, vol. 64, no. 5, pp. 1349-1384, 2022, doi: 10.1007/s10115-022-01674-9.
A. Jayasree, P. Shanmuganathan, P. Ramamurthy, et al., “Types of medication non-adherence & approaches to enhance medication adherence in mental health disorders: a narrative review,” Indian Journal of Psychological Medicine, vol. 46, no. 6, pp. 503-510, 2024, doi: 10.1177/02537176241233745.
V. White, J. Linardon, J. E. Stone, et al., “Online psychological interventions to reduce symptoms of depression, anxiety, and general distress in those with chronic health conditions: a systematic review and meta-analysis of randomized controlled trials,” Psychological Medicine, vol. 52, no. 3, pp. 548-573, 2022, doi: 10.1017/S0033291720002251.
A. Shehu, H. Gommaa, U. S. Usman, et al., “Effect of Psycho-Educational Intervention on Drug Adherence and Quality of Life Among Patients With Schizophrenia in Jigawa State and Nigeria,” International Journal of Scientific Research Updates, vol. 4, no. 1, pp. 163-171, 2022, doi: 10.53430/ijsru.2022.4.1.0103.
J. Buckby, T. Wang, D. Fletcher, et al., “Finding the number of latent states in hidden Markov models using information criteria,” Environmental and Ecological Statistics, vol. 30, no. 4, pp. 797-825, 2023, doi: 10.1007/s10651-023-00584-5.
E. Sidrow, N. Heckman, E. Fortune S M, et al., “Modelling multi-scale, state-switching functional data with hidden Markov models,” Canadian Journal of Statistics, vol. 50, no. 1, pp. 327-356, 2022, doi: 10.1002/cjs.11673.
A. Maruotti, M. Fabbri, and M. Rizzolli, “Multilevel hidden Markov models for behavioral data: A Hawk-and-Dove experiment,” Multivariate Behavioral Research, vol. 57, no. 5, pp. 825-839, 2022, doi: 10.1080/00273171.2021.1912583.
S. Mildiner Moraga and E. Aarts, “Go multivariate: Recommendations on bayesian multilevel hidden Markov models with categorical data,” Multivariate Behavioral Research, vol. 59, no. 1, pp. 17-45, 2024, doi: 10.1080/00273171.2023.2205392.
A. Ravari, F. Ghoreishi S, and M. Imani, “Optimal inference of hidden Markov models through expert-acquired data,” IEEE Transactions on Artificial Intelligence, vol. 5, no. 8, pp. 3985-4000, 2024, doi: 10.1109/TAI.2024.3358261.
A. Gupta, D. Garg, and P. Kumar, “Mining sequential learning trajectories with hidden Markov models for early prediction of at-risk students in e-learning environments,” IEEE Transactions on Learning Technologies, vol. 15, no. 6, pp. 783-797, 2022, doi: 10.1109/TLT.2022.3197486.
X. Cheng and B. Huang, “CSI-based human continuous activity recognition using GMM–HMM,” IEEE Sensors Journal, vol. 22, no. 19, pp. 18709-18717, 2022, doi: 10.1109/JSEN.2022.3198248.
X. Zhao, L. Huang, L. Wang, et al., “Understanding of the dynamics of mobile reading: An HMM model of user engagement and content consumption,” Production and Operations Management, vol. 34, no. 12, pp. 3755-3774, 2025, doi: 10.1111/poms.13964.
X. Ye and M. Han M, “An improved feature extraction algorithm for insider threat using hidden Markov model on user behavior detection,” Information & Computer Security, vol. 30, no. 1, pp. 19-36, 2022, doi: 10.1108/ICS-12-2019-0142.
M. Boeker, L. Hammer H, A. Riegler M, et al., “Prediction of schizophrenia from activity data using hidden Markov model parameters,” Neural Computing and Applications, vol. 35, no. 8, pp. 5619-5630, 2023, doi: 10.1007/s00521-022-07845-7.
Q. Liu, D. Cole, T. Tran, et al., “Intraindividual phenotyping of depression in high-risk youth: An application of a multilevel hidden Markov model,” Development and psychopathology, vol. 36, no. 3, pp. 1262-1271, 2024, doi: 10.1017/S0954579423000500.
J. Wu, G. Ward O, J. Curley, et al., “Markov-modulated Hawkes processes for modeling sporadic and bursty event occurrences in social interactions,” The Annals of Applied Statistics, vol. 16, no. 2, pp. 1171-1190, 2022, doi: 10.1214/21-AOAS1539.
R. Jouini, C. Houaidia, and A. Saidane L, “Hidden markov model for early prediction of the elderly’s dependency evolution in ambient assisted living,” Annals of Telecommunications, vol. 78, no. 9, pp. 599-615, 2023, doi: 10.1007/s12243-023-00964-9.
J. Liu, T. Yue W, M. Leung A C, et al., “Find the Good,” Seek the unity: A hidden Markov model of human-AI delegation dynamics. Mis Quarterly, vol. 49, no. 3, pp. 1185-1204, 2025, doi: 10.25300/MISQ/2024/18232.
S. Faruque, A. Mizuno, L. Wang, et al., “Unique Time-Series Patterns of Behavioral and Psychological Factors in Late-Life Depression: A Computational Psychiatry Approach with Hidden Markov Models,” The American Journal of Geriatric Psychiatry, vol. 32, no. 4, pp. S50-S51, 2024, doi: 10.1016/j.jagp.2024.01.122.
B. Ogbagaber S, Y. Cui, K. Li, et al., “A hidden Markov modeling approach combining objective measure of activity and subjective measure of self-reported sleep to estimate the sleep-wake cycle,” Journal of Applied Statistics, vol. 51, no. 2, pp. 370-387, 2024, doi: 10.1080/02664763.2022.2151576.
K. Archambeau, J. Couto, and L. Van Maanen, “Non-parametric mixture modeling of cognitive psychological data: A new method to disentangle hidden strategies,” Behavior Research Methods, vol. 55, no. 5, pp. 2232-2248, 2023, doi: 10.3758/s13428-022-01837-0.
Y. Tang, Z. Li, G. Wang, et al., “Modeling learning behaviors and predicting performance in an intelligent tutoring system: a two-layer hidden Markov modeling approach,” Interactive Learning Environments, vol. 31, no. 9, pp. 5495-5507, 2023, doi: 10.1080/10494820.2021.2010100.
X. Tang, “A latent hidden Markov model for process data,” psychometrika, vol. 89, no. 1, pp. 205-240, 2024, doi: 10.1007/s11336-023-09938-1.
B. Gardner, A. Arden M, D. Brown, et al., “Developing habit-based health behaviour change interven tions: Twenty-one questions to guide future research,” Psychology & health, vol. 38, no. 4, pp. 518-540, 2023, doi: 10.1080/08870446.2021.2003362.
A. Abrash Walton, L. Nageotte N, E. Heimlich J, et al., “Facilitating behavior change: Introducing the Transtheoretical Model of Behavior Change as a conservation psychology framework and tool for practitioners,” Zoo Biology, vol. 41, no. 5, pp. 386-397, 2022, doi: 10.1002/zoo.21704.
R. Colombi, S. Giordano, and M. Kateri, “Hidden markov models for longitudinal rating data with dynamic response styles,” Statistical Methods & Applications, vol. 33, no. 1, pp. 1-36, 2024, doi: 10.1007/s10260-023-00717-x.
Y. Liu, A. Culpepper S, and Y. Chen, “Identifiability of hidden Markov models for learning trajectories in cognitive diagnosis,” psychometrika, vol. 88, no. 2, pp. 361-386, 2023, doi: 10.1007/s11336-023-09904-x.
S. Zhang, T. Yang L, Y. Zhang, et al., “Tensor-Based Baum–Welch Algorithms in Coupled Hidden Markov Model for Responsible Activity Prediction,” IEEE Transactions on Computational Social Systems, vol. 10, no. 6, pp. 2924-2937, 2023, doi: 10.1109/TCSS.2022.3227458.
B. Benyacoub, S. ElBernoussi, A. Zoglat, et al., “Credit scoring model based on HMM/Baum-Welch method,” Computational Economics, vol. 59, no. 3, pp. 1135-1154, 2022, doi: 10.1007/s10614-021-10122-9.
M. Ouzineb and B. Benyacoub, “Hidden Markov Models Training Using Hybrid Baum Welch-Variable Neighborhood Search Algorithm,” Statistics, Optimization & Information Computing, vol. 10, no. 1, pp. 160-170, 2022, doi: 10.19139/soic-2310-5070-1213.
V. Rezaei Tabar, D. Plewczynski, and H. Fathipor, “Generalized baum-welch and viterbi algorithms based on the direct dependency among observations,” Journal of the Iranian Statistical Society, vol. 17, no. 2, pp. 205-225, 2022, doi: 10.29252/jirss.17.2.10.
J. Lember, “Local Viterbi property in decoding,” Information and Inference: A Journal of the IMA, vol. 12, no. 3, pp. 1267-1294, 2023, doi: 10.1093/imaiai/iaad004.