AI-Enhanced GraphoText Analysis for Tracking Counselling Therapy Progress: Integrating Multimodal Graphology and Machine Learning

Abstract

Despite the robustness of existing instruments, routine manual observation in psychotherapy faces significant challenges, including lack of time, labour, high implementation costs, and potential biases such as response bias and social desirability. This study proposes a dynamic assessment approach using machine learning and multimodal features extracted from handwriting, incorporating graphology-based and content-based features. The integration of content-based and graphology-based features involves combining text and handwriting features with the Support Vector Machine (SVM) using the Radial Basis Function Kernel (RBF). The results show that this approach achieves an impressive accuracy rate of 86.25%. The proposed framework not only improves psychotherapeutic practise, but also offers new insights into human cognition and emotional dynamics by revealing intricate patterns in handwriting. This advance facilitates data-driven decision-making, improves the quality of patient care, and overcomes challenges associated with manual monitoring, including social desirability bias and response set bias. This research paves the way for innovative methods at the interface of mental health and technology, and promises a more objective and efficient approach to monitoring the progress of psychotherapy.