A Review of Geometric Deep Learning Technique for Emotional Detection Systems in the Context of Assistive Learning
DOI:
https://doi.org/10.63746/njtd.v23i1.3480Keywords:
Emotional detection, Human-computer interfaces, Geometric deep learning, Techniques, Emotional detection datasetsAbstract
The study of Emotional Detection Systems (EDS) has gained significant attention in recent years due to its importance in understanding human reactions during interactions with both other humans and machines. EDS involves the use of computer systems to identify human emotions, which can be expressed through various modalities such as facial expressions, text, and speech. While humans can naturally recognize emotions, enabling computer systems to do so remains a complex challenge. Although emotion detection technologies have been in development for decades, there is a continuous need for research to enhance their accuracy and effectiveness, as many existing systems still fall short of optimal performance. Recently, Geometric Deep Learning (GDL) techniques have emerged as a promising alternative to traditional machine learning approaches. By considering the geometric properties of data, GDL enables more efficient learning beyond conventional Euclidean spaces. In every human being, emotion varies from individual even when he or she have the same intonation and facial expression but which may not correspond to their internal state. Also, current EDS may find it difficult to detect the mind or state of mind such as culture, situation, intent, emotion and suppression. More so, some emotion categories are under-represented which makes it hard for models to generalize and also, many EDS are trained on the data sets which may not provide enough sufficiently diverse in culture, age, gender or rely on spontaneous emotions. However, its application to emotion detection remains relatively unexplored. This paper provides a critical review of various modalities used in emotion detection systems. It also analyzes different techniques and approaches, with a particular focus on assessing whether GDL techniques have been integrated into emotion detection models. Additionally, existing emotion detection datasets and performance results from recent studies are discussed. The report clearly states that the adoption of GDL is still partial and not yet universal across all commonalities and there is room for maturation in term of graph-construction best practices. The paper concludes with insights on current challenges and directions for future research. The future direction of GDL in EDS will integrate GDL’s structural intelligence with multimodal, interpretable, and privacy-preserving machine learning paradigms. Such integration will enable adaptive, human-centric systems capable of perceiving and responding to emotional states with better accuracy, empathy, and ethical responsibility.
References
Acheampong, F. A., C. Wenyu, & H. Nunoo?Mensah. (2020). Text?based emotion detection: Advances, challenges, and opportunities. Engineering Reports, 2(7), e12189.
Ahmed, Z., B. Vidgen, & S. A. Hale. (2021). Tackling racial bias in automated online hate detection: Towards fair and accurate classification of hateful online users using geometric deep learning. arXiv preprint arXiv:2103.11806.
Akçay, M. B., & K. O?uz. (2020). Speech emotion recognition: Emotional models, databases, features, preprocessing methods, supporting modalities, and classifiers. Speech Communication, 116, 56–76.
Al Maruf, A., F. Khanam, M. M. Haque, Z. M. Jiyad, F. Mridha, & Z. Aung. (2024). Challenges and opportunities of text-based emotion detection: A survey. IEEE Access.
Alotaibi, F. M. (2019). Classifying text-based emotions using logistic regression.
Alsubai, S. (2023). Emotion Detection Using Deep Normalized Attention-Based Neural Network and Modified-Random Forest. Sensors, 23(1), 225.
Alvarez-Gonzalez, N., A. Kaltenbrunner, & V. Gómez. (2021). Uncovering the limits of text-based emotion detection. arXiv preprint arXiv:2109.01900.
Atz, K., F. Grisoni, & G. Schneider. (2021). Geometric deep learning on molecular representations. Nature Machine Intelligence, 1–10.
Azmin, S., & K. Dhar. (2019). Emotion detection from Bangla text corpus using Naïve Bayes classifier. 2019 4th International Conference on Electrical Information and Communication Technology (EICT),
Benitez-Garcia, G., T. Nakamura, & M. Kaneko. (2018). Multicultural facial expression recognition based on differences of western-caucasian and east-asian facial expressions of emotions. IEICE TRANSACTIONS on Information and Systems, 101(5), 1317–1324.
Besson, P., T. Parrish, A. K. Katsaggelos, & S. K. Bandt. (2021). Geometric deep learning on brain shape predicts sex and age. Computerized Medical Imaging and Graphics, 91, 101939.
Binali, H., & V. Potdar. (2012). Emotion detection state of the art. Proceedings of the CUBE International Information Technology Conference,
Bustos-López, M., N. Cruz-Ramírez, A. Guerra-Hernández, L. N. Sánchez-Morales, & G. Alor-Hernández. (2021). Emotion Detection from Text in Learning Environments: A Review. New Perspectives on Enterprise Decision-Making Applying Artificial Intelligence Techniques, 483–508.
Cao, W., Z. Yan, Z. He, & Z. He. (2020). A comprehensive survey on geometric deep learning. IEEE Access, 8, 35929–35949.
Castro-Vale, I., M. Severo, D. Carvalho, & R. Mota-Cardoso. (2015). Emotion recognition ability test using JACFEE photos: a validity/reliability study of a war veterans' sample and their offspring. Plos one, 10(7), e0132293.
Chen, X., L. Ke, Q. Du, J. Li, & X. Ding. (2021). Facial expression recognition using kernel entropy component analysis network and DAGSVM. Complexity, 2021.
Choi, Y.-J., Y.-W. Lee, & B.-G. Kim. (2021). Residual-based graph convolutional network for emotion recognition in conversation for smart Internet of Things. Big Data, 9(4), 279–288.
Cortiz, D. (2021). Exploring transformers in emotion recognition: a comparison of bert, distillbert, roberta, xlnet and electra. arXiv preprint arXiv:2104.02041.
Dhiman, R., G. S. Kang, & V. Gupta. (2021). Modified dense convolutional networks based emotion detection from speech using its paralinguistic features. Multimedia Tools and Applications, 80(21), 32041–32069.
Du, L., & H. Hu. (2019). Weighted patch-based manifold regularization dictionary pair learning model for facial expression recognition using iterative optimization classification strategy. Computer Vision and Image Understanding, 186, 13–24.
Farhad, M., H. Ismail, S. Harous, M. M. Masud, & A. Beg. (2021). Analysis of Emotion Recognition from Cross-lingual Speech: Arabic, English, and Urdu. 2021 2nd International Conference on Computation, Automation and Knowledge Management (ICCAKM),
Garcia-Garcia, J. M., V. M. Penichet, & M. D. Lozano. (2017). Emotion detection: a technology review. Proceedings of the XVIII international conference on human computer interaction,
Gerken, J. E., J. Aronsson, O. Carlsson, H. Linander, F. Ohlsson, C. Petersson, & D. Persson. (2021). Geometric deep learning and equivariant neural networks. arXiv preprint arXiv:2105.13926.
Gurbuz, M. B., & I. Rekik. (2020). Deep graph normalizer: a geometric deep learning approach for estimating connectional brain templates. International Conference on Medical Image Computing and Computer-Assisted Intervention,
Hasan, M., E. Rundensteiner, & E. Agu. (2019). Automatic emotion detection in text streams by analyzing twitter data. International Journal of Data Science and Analytics, 7(1), 35–51.
Hasan, M., E. Rundensteiner, & E. Agu. (2021). DeepEmotex: Classifying Emotion in Text Messages using Deep Transfer Learning. 2021 IEEE International Conference on Big Data (Big Data),
Ho, N.-H., H.-J. Yang, S.-H. Kim, & G. Lee. (2020). Multimodal approach of speech emotion recognition using multi-level multi-head fusion attention-based recurrent neural network. IEEE Access, 8, 61672–61686.
Jain, U., K. Nathani, N. Ruban, A. N. J. Raj, Z. Zhuang, & V. G. Mahesh. (2018). Cubic SVM classifier based feature extraction and emotion detection from speech signals. 2018 International Conference on Sensor Networks and Signal Processing (SNSP),
James, J. (2021). Citywide traffic speed prediction: A geometric deep learning approach. Knowledge-Based Systems, 212, 106592.
Khan, G., A. Siddiqi, M. U. G. Khan, S. Q. Wahla, & S. Samyan. (2019). Geometric positions and optical flow based emotion detection using MLP and reduced dimensions. IET Image Processing, 13(4), 634–643.
Koch, S., A. Matveev, Z. Jiang, F. Williams, A. Artemov, E. Burnaev, M. Alexa, D. Zorin, & D. Panozzo. (2019). Abc: A big cad model dataset for geometric deep learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,
Krishna, K. V., N. Sainath, & A. M. Posonia. (2022). Speech Emotion Recognition using Machine Learning. 2022 6th International Conference on Computing Methodologies and Communication (ICCMC),
Krishnamoorthy, P., M. Sathiyanarayanan, & H. P. Proença. (2024). A novel and secured email classification and emotion detection using hybrid deep neural network. International Journal of Cognitive Computing in Engineering, 5, 44–57.
Kumar, A., A. Jaiswal, S. Garg, S. Verma, & S. Kumar. (2019). Sentiment analysis using cuckoo search for optimized feature selection on Kaggle tweets. International Journal of Information Retrieval Research (IJIRR), 9(1), 1–15.
Kumar, P., & B. Raman. (2022). A BERT based dual-channel explainable text emotion recognition system. Neural Networks.
Kuruvayil, S., & S. Palaniswamy. (2021). Emotion recognition from facial images with simultaneous occlusion, pose and illumination variations using meta-learning. Journal of King Saud University-Computer and Information Sciences.
Latif, S., A. Qayyum, M. Usman, & J. Qadir. (2018). Cross lingual speech emotion recognition: Urdu vs. western languages. 2018 International Conference on Frontiers of Information Technology (FIT),
Li, H., M. Sui, F. Zhao, Z. Zha, & F. Wu. (2021). Mvt: Mask vision transformer for facial expression recognition in the wild. arXiv preprint arXiv:2106.04520.
Lim, J. Z., J. Mountstephens, & J. Teo. (2020). Emotion recognition using eye-tracking: taxonomy, review and current challenges. Sensors, 20(8), 2384.
Liu, C., K. Hirota, J. Ma, Z. Jia, & Y. Dai. (2021). Facial expression recognition using hybrid features of pixel and geometry. IEEE Access, 9, 18876–18889.
Liu, Z., T. Zhang, K. Yang, P. Thompson, Z. Yu, & S. Ananiadou. (2024). Emotion detection for misinformation: A review. Information Fusion, 102300.
Luna-Jiménez, C., R. Kleinlein, D. Griol, Z. Callejas, J. M. Montero, & F. Fernández-Martínez. (2021). A Proposal for Multimodal Emotion Recognition Using Aural Transformers and Action Units on RAVDESS Dataset. Applied Sciences, 12(1), 327.
Mehta, Y., S. Fatehi, A. Kazameini, C. Stachl, E. Cambria, & S. Eetemadi. (2020). Bottom-up and top-down: Predicting personality with psycholinguistic and language model features. 2020 IEEE International Conference on Data Mining (ICDM),
Minaee, S., M. Minaei, & A. Abdolrashidi. (2021). Deep-emotion: Facial expression recognition using attentional convolutional network. Sensors, 21(9), 3046.
Mollahosseini, A., B. Hasani, & M. H. Mahoor. (2017). Affectnet: A database for facial expression, valence, and arousal computing in the wild. IEEE Transactions on Affective Computing, 10(1), 18–31.
Monti, F., F. Frasca, D. Eynard, D. Mannion, & M. M. Bronstein. (2019). Fake news detection on social media using geometric deep learning. arXiv preprint arXiv:1902.06673.
Moritani, A., R. Ozaki, S. Sakamoto, H. Kameoka, & T. Taniguchi. (2021). Stargan-based emotional voice conversion for japanese phrases. arXiv preprint arXiv:2104.01807.
Murthy, A. R., & K. A. Kumar. (2021). A Review of Different Approaches for Detecting Emotion from Text. IOP Conference Series: Materials Science and Engineering,
Naeem, S., M. Iqbal, M. Saqib, M. Saad, M. S. Raza, Z. Ali, N. Akhtar, M. O. Beg, W. Shahzad, & M. U. Arshad. (2020). Subspace gaussian mixture model for continuous urdu speech recognition using kaldi. 2020 14th International Conference on Open Source Systems and Technologies (ICOSST),
Nandwani, P., & R. Verma. (2021). A review on sentiment analysis and emotion detection from text. Social Network Analysis and Mining, 11(1), 1–19.
Nguyen, D.-P., M.-C. Ho Ba Tho, & T.-T. Dao. (2021). Enhanced facial expression recognition using 3D point sets and geometric deep learning. Medical & Biological Engineering & Computing, 59(6), 1235–1244.
Olah, J., S. Baruah, D. Bose, & S. Narayanan. (2021). Cross Domain Emotion Recognition using Few Shot Knowledge Transfer. arXiv preprint arXiv:2110.05021.
Oloyede, M., G. Hancke, H. Myburgh, & A. Onumanyi. (2019). A new evaluation function for face image enhancement in unconstrained environments using metaheuristic algorithms. EURASIP Journal on Image and Video Processing, 2019(1), 1–18.
Oloyede, M. O., & G. P. Hancke. (2016). Unimodal and multimodal biometric sensing systems: a review. IEEE Access, 4, 7532–7555.
Oloyede, M. O., G. P. Hancke, & N. Kapileswar. (2017). Evaluating the effect of occlusion in face recognition systems. 2017 IEEE AFRICON,
Oloyede, M. O., G. P. Hancke, & H. C. Myburgh. (2018). Improving face recognition systems using a new image enhancement technique, hybrid features and the convolutional neural network. IEEE Access, 6, 75181–75191.
Oloyede, M. O., G. P. Hancke, & H. C. Myburgh. (2020). A review on face recognition systems: recent approaches and challenges. Multimedia Tools and Applications, 79(37), 27891–27922.
PS, S., & G. Mahalakshmi. (2017). Emotion models: a review. International Journal of Control Theory and Applications, 10, 651–657.
Ribeiro, F. L., S. Bollmann, & A. M. Puckett. (2021). Predicting the retinotopic organization of human visual cortex from anatomy using geometric deep learning. NeuroImage, 244, 118624.
Rupapara, V., F. Rustam, H. F. Shahzad, A. Mehmood, I. Ashraf, & G. S. Choi. (2021). Impact of SMOTE on imbalanced text features for toxic comments classification using RVVC model. IEEE Access, 9, 78621–78634.
Sailunaz, K., M. Dhaliwal, J. Rokne, & R. Alhajj. (2018). Emotion detection from text and speech: a survey. Social Network Analysis and Mining, 8(1), 1–26.
Samara, A., L. Galway, R. Bond, & H. Wang. (2019). Affective state detection via facial expression analysis within a human–computer interaction context. Journal of Ambient Intelligence and Humanized Computing, 10(6), 2175–2184.
Shagdar, Z., M. Ullah, H. Ullah, & F. A. Cheikh. (2021). Geometric deep learning for multi-object tracking: A brief review. 2021 9th European Workshop on Visual Information Processing (EUVIP),
Singh, J., & R. Gill. (2022). Multimodal Emotion Recognition System Using Machine Learning and Psychological Signals: A Review. Soft Computing: Theories and Applications, 657–666.
Susskind, J., G. Littlewort, M. Bartlett, J. Movellan, & A. Anderson. (2007). Human and computer recognition of facial expressions of emotion. Neuropsychologia, 45(1), 152–162.
Suzuki, T., A. Taya, & Y. Tobe. (2021). VFep: 3D Graphic Face Representation Based on Voice-based Emotion Recognition. 2021 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops),
Tariq, Z., S. K. Shah, & Y. Lee. (2019). Speech emotion detection using iot based deep learning for health care. 2019 IEEE International Conference on Big Data (Big Data),
Tarnowski, P., M. Ko?odziej, A. Majkowski, & R. J. Rak. (2017). Emotion recognition using facial expressions. Procedia Computer Science, 108, 1175–1184.
Tomba, K., J. Dumoulin, E. Mugellini, O. Abou Khaled, & S. Hawila. (2018). Stress Detection Through Speech Analysis. ICETE (1),
Tripathi, S., A. Kumar, A. Ramesh, C. Singh, & P. Yenigalla. (2019). Deep learning based emotion recognition system using speech features and transcriptions. arXiv preprint arXiv:1906.05681.
Tu, G., T. Xie, B. Liang, H. Wang, & R. Xu. (2024). Adaptive Graph Learning for Multimodal Conversational Emotion Detection. Proceedings of the AAAI Conference on Artificial Intelligence,
Tuhin, R. A., B. K. Paul, F. Nawrine, M. Akter, & A. K. Das. (2019). An automated system of sentiment analysis from Bangla text using supervised learning techniques. 2019 IEEE 4th International Conference on Computer and Communication Systems (ICCCS),
Turabzadeh, S., H. Meng, R. M. Swash, M. Pleva, & J. Juhar. (2018). Facial expression emotion detection for real-time embedded systems. Technologies, 6(1), 17.
Verma, G., & H. Verma. (2020). Hybrid-deep learning model for emotion recognition using facial expressions. The Review of Socionetwork Strategies, 14(2), 171–180.
Yang, K., C. Wang, Z. Sarsenbayeva, B. Tag, T. Dingler, G. Wadley, & J. Goncalves. (2021). Benchmarking commercial emotion detection systems using realistic distortions of facial image datasets. The Visual Computer, 37(6), 1447–1466.
Zad, S., M. Heidari, H. James Jr, & O. Uzuner. (2021). Emotion detection of textual data: An interdisciplinary survey. 2021 IEEE World AI IoT Congress (AIIoT),
Zamil, A. A. A., S. Hasan, S. M. J. Baki, J. M. Adam, & I. Zaman. (2019). Emotion detection from speech signals using voting mechanism on classified frames. 2019 International Conference on Robotics, Electrical and Signal Processing Techniques (ICREST),
Zhang, D., L. Wu, C. Sun, S. Li, Q. Zhu, & G. Zhou. (2019). Modeling both Context-and Speaker-Sensitive Dependence for Emotion Detection in Multi-speaker Conversations. IJCAI,
Zhang, Y., J. Fu, D. She, Y. Zhang, S. Wang, & J. Yang. (2018). Text Emotion Distribution Learning via Multi-Task Convolutional Neural Network. IJCAI,
Zhao, Z., Q. Liu, & S. Wang. (2021). Learning deep global multi-scale and local attention features for facial expression recognition in the wild. IEEE Transactions on Image Processing, 30, 6544–6556.
Zhong, B., Z. Qin, S. Yang, J. Chen, N. Mudrick, M. Taub, R. Azevedo, & E. Lobaton. (2017). Emotion recognition with facial expressions and physiological signals. 2017 IEEE symposium series on computational intelligence (SSCI),
Zhong, P., D. Wang, & C. Miao. (2019). Knowledge-enriched transformer for emotion detection in textual conversations. arXiv preprint arXiv:1909.10681.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Nigerian Journal of Technological Development

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
In accordance with the Copyright Act of 1976, which became effective January 1, 1978, the following statement signed by each author must accompany the manuscript submitted: "I, the undersigned author, transfer all copyright ownership of the manuscript referenced above to the Nigerian Journal of Technological Development, in the event the work is published. I warrant that the article is original, does not infringe upon any copyright or other proprietary right of any third party, is not under consideration by another journal, and has not been published previously. I have reviewed and approved the submitted version of the manuscript and agree to its publication in the Nigerian Journal of Technological Development." A copyright transfer form can be downloaded from the NJTD Website (http://njtd.com.ng/index.php/njtd). Author(s) will be consulted, whenever possible, regarding republication of material. All authors must have access to the data presented, and the authors and sponsor (if applicable) must agree to share original data with the editor if requested.
