Real-Time Mental Health Monitoring for Metaverse Consumers to Ameliorate the Negative Impacts of Escapism and Post Trauma Stress Disorder

Mazumdar, Hirak; Sathvik, Msvpj; Chakraborty, Chinmay; Unhelkar, Bhuvan; Mahmoudi, Saïd

doi:10.1109/TCE.2024.3364169

Article (Scientific journals)

Real-Time Mental Health Monitoring for Metaverse Consumers to Ameliorate the Negative Impacts of Escapism and Post Trauma Stress Disorder

Mazumdar, Hirak; Sathvik, Msvpj; Chakraborty, Chinmay et al.

2024 • In IEEE Transactions on Consumer Electronics, 70 (1), p. 2129 - 2136

Peer Reviewed verified by ORBi

Permalink
https://hdl.handle.net/20.500.12907/51461

DOI
10.1109/TCE.2024.3364169

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

TCE_Metaverse_Final.pdf

Author preprint (2.72 MB)

Request a copy

All documents in ORBi UMONS are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

escapism; mental health; Metaverse; real time monitoring; virtual reality; Anxiety disorder; Escapism; Mental health; Metaverses; Posttraumatic stress disorder; Real time monitoring; Real- time; Social networking (online); Media Technology; Electrical and Electronic Engineering

Abstract :

[en] The emergence of the metaverse, like any other technology, presents both advantages and disadvantages. On the positive side, it can greatly enhance experiences in gaming, entertainment, training, and more, offering significant benefits to users. Conversely, there are notable drawbacks, particularly concerning mental health issues such as escapism and post-traumatic stress disorder (PTSD). The detection of the signs of the disorders can help users to take precautions. This paper introduces a novel annotated dataset for monitoring mental health of consumers in metaverse environments, with a specific emphasis on escapism and PTSD. The dataset encompasses user-generated content, chat logs, virtual world activities, and demographic information, collected from reddit and twitter posts. A team of mental health experts has systematically annotated the dataset, categorizing content, conducting sentiment analysis, and providing contextual assessments to facilitate research on mental health patterns in virtual spaces. This resource opens opportunities for investigating escapism and PTSD.

Disciplines :

Computer science

Author, co-author :

Mazumdar, Hirak ; Woxsen University, School of Technology, Hyderabad, India

Sathvik, Msvpj ; Indian Institute of Information Technology Dharwad, Electronics and Communication Engineering, Dharwad, India

Chakraborty, Chinmay ; Birla Institute of Technology, Electronics and Communication Engineering, Mesra, India

Unhelkar, Bhuvan; University of South Florida, Muma School of Business, Tampa, United States

Mahmoudi, Saïd ; Université de Mons - UMONS > Faculté Polytechnique > Service Informatique, Logiciel et Intelligence artificielle

Language :

English

Title :

Real-Time Mental Health Monitoring for Metaverse Consumers to Ameliorate the Negative Impacts of Escapism and Post Trauma Stress Disorder

Publication date :

February 2024

Journal title :

IEEE Transactions on Consumer Electronics

ISSN :

0098-3063

Publisher :

Institute of Electrical and Electronics Engineers Inc.

Volume :

Issue :

Pages :

2129 - 2136

Peer reviewed :

Peer Reviewed verified by ORBi

Additional URL :

http://xplorestaging.ieee.org/ielx7/30/10510045/10430459.pdf?arnumber=10430459

Research unit :

F114 - Informatique, Logiciel et Intelligence artificielle

Research institute :

R300 - Institut de Recherche en Technologies de l'Information et Sciences de l'Informatique

Available on ORBi UMONS :

since 14 January 2025

Statistics

Number of views

0 (0 by UMONS)

Number of downloads

0 (0 by UMONS)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

Bibliography

Y. Sun, Z. Chen, M. Tao, and H. Liu, "Communications, caching, and computing for mobile virtual reality: Modeling and tradeoff," IEEE Trans. Commun., vol. 67, no. 11, pp. 7573-7586, Nov. 2019.
X. Ge, L. Pan, Q. Li, G. Mao, and S. Tu, "Multipath cooperative communications networks for augmented and virtual reality transmission," IEEE Trans. Multimedia, vol. 19, no. 10, pp. 2345-2358, Oct. 2017.
N. Pellas, A. Dengel, and A. Christopoulos, "A scoping review of immersive virtual reality in stem education," IEEE Trans. Learn. Technol., vol. 13, no. 4, pp. 748-761, Oct.-Dec. 2020.
G. C. Burdea, "Invited review: The synergy between virtual reality and robotics," IEEE Trans. Robot. Autom., vol. 15, no. 3, pp. 400-410, Jun. 1999.
H. Zhao, A. R. Swanson, A. S. Weitlauf, Z. E. Warren, and N. Sarkar, "Hand-in-hand: A communication-enhancement collaborative virtual reality system for promoting social interaction in children with autism spectrum disorders," IEEE Trans. Human-Mach. Syst., vol. 48, no. 2, pp. 136-148, Apr. 2018.
S. Järvelä, B. Cowley, M. Salminen, G. Jacucci, J. Hamari, and N. Ravaja, "Augmented virtual reality meditation: Shared dyadic biofeedback increases social presence via respiratory synchrony," ACM Trans. Soc. Comput., vol. 4, no. 2, pp. 1-19, 2021.
J. Tham, A. H. Duin, L. Gee, N. Ernst, B. Abdelqader, and M. McGrath, "Understanding virtual reality: Presence, embodiment, and professional practice," IEEE Trans. Prof. Commun., vol. 61, no. 2, pp. 178-195, Jun. 2018.
H. Oagaz, B. Schoun, and M.-H. Choi, "Performance improvement and skill transfer in table tennis through training in virtual reality," IEEE Trans. Vis. Comput. Graph., vol. 28, no. 12, pp. 4332-4343, Dec. 2022.
P. Salamin, T. Tadi, O. Blanke, F. Vexo, and D. Thalmann, "Quantifying effects of exposure to the third and first-person perspectives in virtualreality-based training," IEEE Trans. Learn. Technol., vol. 3, no. 3, pp. 272-276, Jul.-Sep. 2010.
D.-I. D. Han, Y. Bergs, and N. Moorhouse, "Virtual reality consumer experience escapes: Preparing for the metaverse," Virtual Real., vol. 26, no. 4, pp. 1443-1458, 2022.
Z. Qasem, H. Y. Hmoud, D. Hajawi, and J. Z. Al Zoubi, "The effect of technostress on cyberbullying in metaverse social platforms," in Proc. Int. Working Conf. Transf. Diff. IT, 2022, pp. 291-296.
S. Yang, "Storytelling and user experience in the cultural metaverse," Heliyon, vol. 9, no. 4, 2023, Art. no. e14759.
P. Henz, "The psychological impact of the metaverse," Discov. Psychol., vol. 2, no. 1, p. 47, 2022.
S. S. Usmani, M. Sharath, and M. Mehendale, "Future of mental health in the metaverse," Gen. Psychiatr., vol. 35, no. 4, 2022, Art. no. e100825.
B. C. Ooi et al., "The metaverse data deluge: What can we do about it?" 2022, arXiv:2206.10326.
Y. Shelke and C. Chakraborty, "An end-to-end shape-preserving point completion network," IEEE Comput. Graph. Appl., vol. 41, no. 3, pp. 124-138, May 2021.
H. K. Bhuyan and C. Chakraborty, "Explainable machine learning for data extraction across computational social system," IEEE Trans. Comput. Soc. Syst., early access, May 2, 2022, doi: 10.1109/TCSS.2022.3164993.
Y. Chen, W. Lin, and G. Chen, "On application of metaverse in medical education via platform of medical electronic journals: A case study of journal of trauma and emergency electronic version," 2022, preprint.
T. D. Parsons, "Virtual simulations and the second life metaverse: Paradigm shift in neuropsychological assessment," in Virtual Worlds and Metaverse Platforms: New Communication and Identity Paradigms. Hershey, PA, USA: IGI Global, 2012, pp. 234-250.
W. López-Ojeda and R. A. Hurley, "The medical metaverse, part 1: Introduction, definitions, and new horizons for neuropsychiatry," J. Neuropsy. Clin. Neurosci., vol. 35, no. 1, pp. A4-3, 2023.
I. Yildiz and N. I. Tanyildizi, "An analysis of news containing cyberbullying in the metaverse," in Handbook of Research on Bullying in Media and Beyond. Hershey, PA, USA: IGI Global, 2023, pp. 196-214.
R. Di Pietro and S. Cresci, "Metaverse: security and privacy issues," in Proc. 3rd IEEE Int. Conf. Trust, Privacy Security Intell. Syst. Appl. (TPS-ISA), 2021, pp. 281-288.
H. Mazumdar, C. Chakraborty, M. Sathvik, P. Jayakumar, and A. Kaushik, "Optimizing pix2pix GAN with attention mechanisms for AI-driven polyp segmentation in IoMT-enabled smart healthcare," IEEE J. Biomed. Health Inform., early access, Oct. 31, 2023, doi: 10.1109/JBHI.2023.3328962.
Y. Han and S. Oh, "Investigation and research on the negotiation space of mental and mental illness based on metaverse," in Proc. Int. Conf. Inf. Commun. Technol. Converg. (ICTC), 2021, pp. 673-677.
A. Cerasa, A. Gaggioli, F. Marino, G. Riva, and G. Pioggia, "The promise of the metaverse in mental health: The new era of medverse," Heliyon, vol. 8, Nov. 2022, Art. no. e11762.
J. G. Kahambing, "Metaverse, mental health and museums in post-covid-19," J. Public Health, vol. 45, no. 2, pp. e382-e383, 2023.
D. D. B. Situmorang, "Rapid tele-psychotherapy" with single-session music therapy in the metaverse: An alternative solution for mental health services in the future," Palliat. Support. Care, vol. 21, no. 5, pp. 944-945, 2022.
D. D. B. Situmorang, "Will metaverse become a more exciting place to listen to music streaming for mental health?" J. Public Health, vol. 45, no. 2, pp. e363-e364, 2023.
D. D. B. Situmorang, "Metaverse as a new place for online mental health services in the post-covid-19 era: Is it a challenge or an opportunity?" J. Public Health, vol. 45, no. 2, pp. e379-e380, 2023.
J. Li, "Impact of metaverse cultural communication on the mental health of international students in China: Highlighting effects of healthcare anxiety and cyberchondria," A. J. Health Behav., vol. 46, no. 6, pp. 809-820, 2022.
I. Ud Din and A. Almogren, "Exploring the psychological effects of metaverse on mental health and well-being," Inf. Technol. Tour., vol. 25, pp. 367-389, Aug. 2023.
V. Paquin, M. Ferrari, H. Sekhon, and S. Rej, "Time to think "meta": A critical viewpoint on the risks and benefits of virtual worlds for mental health," JMIR Serious Games, vol. 11, Feb. 2023, Art. no. e43388.
B. Guo, "Highlighting effects of flipped learning on mental health through metaverse: Moderating impact of e-learning and cyber resilience," Am. J. Health Behav., vol. 46, no. 6, pp. 683-694, 2022.
S. K. Jagatheesaperumal, K. Ahmad, A. Al-Fuqaha, and J. Qadir, "Advancing education through extended reality and Internet of Everything enabled metaverses: Applications, challenges, and open issues," IEEE Trans. Learn. Technol., early access, Jan. 26, 2024, doi: 10.1109/TLT.2024.3358859.
Z. Huang, D.-H. Choi, B. Lai, Z. Lu, and H. Tian, "Metaverse-based virtual reality experience and endurance performance in sports economy: Mediating role of mental health and performance anxiety," Front. Public Health, vol. 10, Oct. 2022, Art. no. 991489.
B. K. Wiederhold, "(Mental) healthcare consumerism in the metaverse: Is there a benefit?" Cyberpsychol. Behav. Soc. Netw., vol. 26, no. 3, pp. 145-146, 2023.
W. Yuan, "Identifying the effect of digital healthcare products in metaverse on mental health: Studying the interaction of cyberchondria and technophobia," Am. J. Health Behav., vol. 46, no. 6, pp. 729-739, 2022.
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, "BERT: Pre-training of deep bidirectional transformers for language understanding," 2019, arXiv:1810.04805.
Z. Lan, M. Chen, S. Goodman, K. Gimpel, P. Sharma, and R. Soricut, "Albert: A lite BERT for self-supervised learning of language representations," 2020, arXiv:1909.11942.
V. Sanh, L. Debut, J. Chaumond, and T. Wolf, "Distilbert, a distilled version of BERT: Smaller, faster, cheaper and lighter," 2020, arXiv:1910.01108.
P. He, X. Liu, J. Gao, and W. Chen, "DeBERTA: Decoding-enhanced BERT with disentangled attention," 2021, arXiv:2006.03654.
S. Ji, T. Zhang, L. Ansari, J. Fu, P. Tiwari, and E. Cambria, "MentalBERT: Publicly available pretrained language models for mental healthcare," in Proc. LREC, 2022, pp. 1-8.
K. Huang, J. Altosaar, and R. Ranganath, "ClinicaLBERT: Modeling clinical notes and predicting hospital readmission," 2020, arXiv:1904.05342.
V. Vajre, M. Naylor, U. Kamath, and A. Shehu, "PsychBERT: A mental health language model for social media mental health behavioral analysis," in Proc. IEEE Int. Conf. Bioinform. Biomed. (BIBM), 2021, pp. 1077-1082.
T. B. Brown et al., "Language models are few-shot learners," 2020, arXiv:2005.14165.
D. J. C. MacKay, Information Theory, Inference and Learning Algorithms. Cambridge, U.K.: Cambridge Univ. Press, 2003.
F. Topsøe, "Bounds for entropy and divergence for distributions over a two-element set," J. Ineq. Pure Appl. Math, vol. 2, no. 2, Jun. 2001.