The use of machine learning to support
the therapeutic process – strengths and
weaknesses

Adam Lewanowicz; Maria Wiśniewski; Wojciech Oronowicz-Jaskowiak

doi:10.5114/ppn.2022.125050

eISSN: 2720-5371
ISSN: 1230-2813

Advances in Psychiatry and Neurology/Postępy Psychiatrii i Neurologii

Bieżący numer Archiwum Artykuły zaakceptowane O czasopiśmie Rada naukowa Bazy indeksacyjne Prenumerata Kontakt Zasady publikacji prac Opłaty publikacyjne Standardy etyczne i procedury

Panel Redakcyjny

Zgłaszanie i recenzowanie prac online

Wyszukiwanie

Zasady redakcyjne

Sarajevo Declaration on Integrity and Visibility of Scholarly Publications

Bez opłat za publikację

Otwarty dostęp

4/2022
vol. 31

Poleć ten artykuł:

Wyślij znajomemu

Skopiuj link:

Udostępnij:

Artykuł przeglądowy

The use of machine learning to support the therapeutic process – strengths and weaknesses

Adam Lewanowicz

¹

,

Maria Wiśniewski

¹

,

Wojciech Oronowicz-Jaskowiak

²

SWPS University, Warsaw, Poland
Faculty of Information Technology, Polish-Japanese Academy of Information Technology, Warsaw, Poland

Adv Psychiatry Neurol 2022; 31 (4): 167-173

DOI: https://doi.org/10.5114/ppn.2022.125050

Data publikacji online: 2023/02/14

Plik artykułu:

- 4-PPN-00246.pdf [0.16 MB]

Pobierz cytowanie

Metryki PlumX:

INTRODUCTION

Technological progress provides new solutions, though their implementation in practice was delayed due to the insufficient computing power of the relevant hardware. Artificial neural networks, “artificial intelligence” or machine learning dominate an increasing number of areas of human activity, making many activities automatic, and thus affecting the safety and comfort of life. Autonomous cars are produced that analyse images from cameras and decide whether the road is safe or whether the driver should be notified of the impending danger [1]. For years, new aeroplanes have been obligatorily equipped with systems that analyse risk factors on an ongoing basis, mainly in the form of advanced statistical calculations, in order to notify the pilot in advance of impending danger or the unusual behaviour [2]. The new mobile phones are equipped with the function of active learning based on the user’s behaviour, thus enabling him to propose a specific activity at a given time. Medicine also uses artificial intelligence, including models leading to a reduction in the percentage of misdiagnosis related to breast cancer detection through deep learning techniques and training on images collected during mammography examinations [3]. All of the above examples are just a fraction of the possibilities of applying machine learning in the context of devices used by people today. The aim of this article was to review the use of machine learning models in psychotherapy.

THE USE OF NEW TECHNOLOGIES IN PREVENTION AND PSYCHOTHERAPY

The dynamic development of technologies raises the question of the possibility of their application in clini cal practice, in particular that of psychiatrists and clinical psychologists. Pilot studies have shown that machine learning approaches could be a useful tool in the development of advances in psychotherapeutic processes, allowing the study of numerous simultaneous variables without assuming linearity [4]. According to research, machine learning can allow inferences at the individual level. Therefore it is a promising approach for prediction in the psychotherapeutic context to improve treatment efficacy [5], and also e.g., determining which patients will benefit from cognitive-behavioural therapy (CBT) [6]. One of the most interesting examples of the use of technologically advanced solutions is the SPARX game (Smart, Positive, Active, Realistic, X-factor thoughts), the function of which is to help in the behavioural and cognitive therapy of adolescents suffering from depression [7]. It was developed by the University of New Zealand Auckland in cooperation with Metia Interactive, and its aim is to teach young people suffering from depression how to cope with difficult situations. SPARX is based on the RPG model – Role Play Game – in which everyone creates and develops their own character. Users can learn to face real problems by engaging with in-game characters. Research conducted in New Zealand shows that the SPARX game is an effective source of information for teenagers, is a comparable solution to classic therapy, and may turn out to be much cheaper than it. It is also an alternative for people who are reluctant to engage with conventional therapy [8].

Currently, the literature distinguishes at least a few applications of new technologies of varying degrees of advancement, with machine learning at the forefront [9]. It seems that the researchers involved are most interested in personalizing notifications of therapeutic applications, modifying therapeutic programs in a manner adapted to the patients problems, and conducting “intelligent” conversations with them.

Artificial neural networks are information structures modelled on the work of the nervous system [10]. However, it is difficult to equate the concept of neural networks and artificial intelligence, because the tasks solved by neural networks are only computational. The theory of artificial intelligence, on the other hand, assumes that every aspect of learning or other property related to the thought process can, in principle, be so precisely described that it is possible to create a machine that simulates it and improves itself [11]. Neural networks, however, are increasingly becoming the basis for the development of “real” artificial intelligence, the operation of which is to evoke the intelligence attributed to people, and therefore, above all, the ability to independently infer and extract facts from single events. Currently used machine learning methods, including neural networks, even if they are exaggeratedly referred to as “artificial intelligence”, undoubtedly bring us closer to entrusting more and more tasks to machines [12, 13].

Neural networks can be used to learn the classification of various phenomena, where the nature of the information is not, as we will see below, a limitation. Machine learning algorithms offer a suite of methods able to deal with data-base analysis complexity and can be used to extend the toolbox of psychotherapy researchers [14]. As training data, text, photos, videos, sounds, or numerical data such as geographic location, and even the level of cloud cover or temperature are used as training data. Network architecture is changing, allowing the use of specific types of data, but the neural networks themselves can be combined into larger assemblies, which enables the use of different types of materials at the same time [15].

PROPOSING THERAPEUTIC INTERVENTIONS AT SPECIFIED TIMES

The operation of neural networks consists, in simple terms, of analysing the input data, performing calculations and presenting the output data [16]. Illustrating the above with the example of image analysis, it is possible to train artificial neural networks to recognize images of self-mutilation by presenting a collection of several hundred images of this type. The network learns by itself to recognize specific patterns (in this case, it will most often be sharp objects, darker background, blood), and then, when submitting a photograph that was not analysed before, to draw conclusions about its belonging to the appropriate class. In this case we are talking about photos showing self-mutilation or photos that are “safe” in this respect [17].

It is also possible to learn to recognize the user’s behaviour based on the way that they use their mobile phone. This behaviour is not limited to the application that the person is using. It can also include time, geography, or biological activity. Mobile phone users are increasingly wearing smart watches, which essentially reflect the construction of miniature mobile phones that successfully record vital signs and can continue learning about users’ habits [18]. These include: the daily number of steps, physical activity, heart rate, stress levels, the so-called body battery (charging the body with “energy”), the level of fluids consumed or even a plan for and control of a medical treatment [19]. Based on the above data, information that can potentially be used for the purposes of therapeutic applications, can be obtained [20]. Table 1 presents examples of situation descriptions, the nature of the collected data and the therapeutic intervention.

Table 1

Hypothetical studies of patients, presenting the possibilities of using machine learning methods

Hypothetical patient	Health context	Actual behaviour of the patient	Input data “seen” by the application	Possible actions of the application
1.	The patient has been diagnosed with social phobia. She is undergoing pharmacotherapy and psychotherapy.	The patient and her partner left their place of residence and went to a public space. While travelling on the subway, she witnessed a situation in which her partner was ridiculed for her appearance. The patient’s heart rate increased significantly, she might began to think about self-harm. After returning home, she searched the Internet for information related to suicide.	- Changing the location from “Home” to “Other”. - Registration of a significantly higher heart rate than the average for a given user, with no registration of physical activity. - Registration of searching for terms marked as “dangerous”.	Sending a notification to the user about the possibility of obtaining psychiatric and psychological assistance. In a wider variant, after prior consent of the patient – sending an alert to the person conducting the treatment.
2.	The patient was diagnosed with a depressive disorder. She is undergoing pharmacotherapy and psychotherapy.	For the last two weeks, the patient led a relatively active lifestyle, and the disease did not significantly affect her functioning. Recently, her sister has been feeling worse and has more health problems, which is why the patient’s mood is clearly depressed. The patient leaves home less often, searches for new information and uses a mobile phone less often. She spends most of the day in bed. She doesn’t listen to music, does not browse the Internet, and if she does, she looks for information about death.	- Changing the location from “Home” to “Other” is made much less frequently than usual. - Physical activity is much less frequent than usual. - Registration of searches for terms marked as “dangerous”.	Sending a notification to the user with a suggestion to connect to the person conducting their treatment.

The advantage of using the interventions described in the table above is that they are tailored to a specific time when the patient appears to be going through a more difficult period. Based on the profile of information entered by the application, it would be possible to act adequately to the threats and provide appropriate help. However, there are at least several risks associated with the functionalities proposed.

First, the complexity of human behaviour may be beyond the ability of an application to fully describe and classify. In other words, the set of data made “visible” by a given application may not be sufficient to obtain an overall picture of the situation. Analysing the above on the basis of a clinical example, if a given patient decided not to wear a smartwatch on a specific day, and he would not search for information on self-harming methods via a mobile phone, but on a computer, without searching for or exchanging information with mobile phone, then the scope of data required for sending the corresponding notification would not be complete. This means that an all-data-catching system would need to be integrated with every possible device that could capture relevant variables, and these devices would need to be contactless, charged and in use.

Secondly, behaviours that are “visible” to a mobile phone, which could indicate, for example, a depressed mood, do not have to have universal meanings. The most visible and dangerous behaviour seems to be active search for information about suicide, which is relatively easily interpreted by the application [21]. However, if a person’s depressed mood is manifested by playing computer games more often (as a replacement strategy for coping with negative emotions) or walking alone, their identification will be much more difficult. The system may show more frequent physical activity and a desire to leave the house, mistakenly attributing it to well-being. The solution to the above problem could be to precede the application’s functioning with a detailed interview with a clinician, which would allow for a precise specification of the patient’s behaviour and strategies for coping with negative emotions.

MODIFICATION OF COMPUTERISED THERAPEUTIC PROGRAMS

For several years, computer programs have been successfully used to help patients face the anxiety they experience in a virtual environment [22]. Therapeutic programs of this type are most often based on the concept of behavioural therapy for phobias, which assumes that repeated exposure to a factor that causes anxiety in a given person causes the anxiety to disappear over time. It is also important that contact occurs in a controlled manner, most often using relaxation methods, in an environment that is safe for the patient [23]. For this reason, therapists more and more often use special computer programs and virtual or augmented reality devices¹.

Standard programs of this type do not use machine learning solutions. As a rule, they display a given image and allow the patient to interact with the anxiety-causing object, but do not react actively to its behaviour. The use of machine learning could allow for increasing the effectiveness of these types of program and adapting them to the real needs of patients. Table 2 presents the way of working with the patient in the “traditional” approach and the possibilities of using machine learning, including neural networks, to support therapeutic work².

Table 2

Hypothetical studies of patients, presenting the possibilities of using machine learning methods

Hypothetical patient	Operation of the “traditional” program	Patient’s behaviour	Operation of the program using machine learning
1.	A white room is displayed with only the table and a jar visible. There is a black spider in the jar. The user can approach it, he is encouraged to do so by his therapist. He knows that the spider will not get out of the jar and he can safely hold it in his hand. He can also open the jar to let the spider out. Relaxing music is playing in the background.	The patient is afraid to approach the jar, he is afraid of black spiders (he remembers these from his childhood). He has an accelerated pulse, despite the fact that he does not come close to the jar, but stands still. Contrary to expectations, the pulse does not slow down, because the patient constantly recreates the experience with the black spider. He likes a piece of relaxation music, it is observable that his pulse is slowing down a little. He reacts with resignation to the therapist’s encouragement.	- Changing the colour of the spider and checking to what extent its properties (type, size, colour) affect the vital parameters of the patient. - Adjusting the program to the stage of therapeutic work, in this case searching for the types of spiders that give rise to the least fear of the patient. - Active use of information about the type of music he prefers, more frequent playback of fragments that facilitate the slowing down of the patient’s pulse.
2.	There are several dozen people (men and women) in the room who do various things (some of them listen to the present lecture, some deal with other matters). The patient is to go in front of the group of people, take the spot of the presenter and read the paper.	The patient is most afraid of the moment before taking the stage, his pulse gradually increases until the moment he starts reading. He constantly thinks about possible embarrassment. He remembers the moment when he presented a paper that was criticized by a group of men. He delays the moment of taking the stage. He closes his eyes.	- Verifying the extent to which the number of people in the room affects the patient’s vital signs and the use of this information in the program. - Checking whether the patient’s experience are related to a specific gender or age of the listeners.
3.	In SPARX, adolescents learn to cope with a depressive disorder. During the games, the patient receives questions and suggestions from the character leading the game, thanks to which the game detects differences in mood or in the patient’s perception of himself.	Unlike in a classic therapy session, you can pause the game and come back to it when you feel like it. It is also easy to forget about tasks to be performed, and the limited number of answers to questions profiling the patient’s condition may lead to the omission of important aspects of the therapy or to ignoring the indications for another form of therapy.	- The game can “learn” the patient, thanks to which the displayed messages will be personalized after a short time, making this form of therapy more effective. - The program can be connected to other mobile devices, such as a smartphone or a smart watch measuring physical activity, thanks to which the patient can receive notifications about the game. - All premises can be collected in one place and analysed by the system showing, among other things, the level of stress while playing SPARX, or how the player feels before and after the game. - The systems can be integrated with the psychotherapist’s device, thanks to which he can have control over the current condition of the adolescent.
4.	Educational applications such as Talking Photo Apps, where a person with aphasia can practice language and work on improving visual memory through the use of images. The main task of these applications is to support stories told through photography – sharing photos while communicating with a doctor, speech therapist or people from the patient’s close circle.	The photo database is a limited set, and an application without a built-in “learning” engine cannot provide a greater range of communication structures consistent with the user’s future abilities. These applications support communication, but do not allow the user to practice talking to themselves in a critical context – they are not able to show the mistakes made. These applications, while effective, provide an indirect way to learn to communicate.	- Adaptation of the application to the current condition of the patient – while monitoring the progress, it is possible to control the effort put into a given thematic group. - After performing the first exercises with other people, their presence in the following ones is not required each time. - Applications extended with self-learning elements may become the basic form of rehabilitation of people with aphasia, where the therapist or speech therapist will support other activities, not the other way round.

CONDUCTING “INTELLIGENT” CONVERSATIONS WITH PATIENTS, WITH THE USE OF BOTS

Machine learning is successfully used to conduct conversations similar to person-to-person interactions, while the conversation is actually conducted with a computer [24, 25]. This technology is most often based on the use of neural networks to analyse the text entered, and then selecting the most appropriate answer from a given pool. Thus, the text entered by the user of the application is free, while the answers are previously determined by the program’s creators. Conversations are conducted with bots, i.e. with a dedicated type of computer program. Such solutions are commonly used in Internet services, allowing, among other things, the provision of technical support without the need to involve the employees of a given service [26]. The use of technological solutions of this type in a medical or therapeutic context can be done in several ways [27].

Among these are applications that, based on the entered information, allow for the performance of a working diagnosis. The task of the application user is to conduct a casual conversation with the bot. Based on the type of symptoms symptoms and the way the user formulates statements, a preliminary diagnosis is made. These systems have become, especially during the COVID-19 pandemic, a common form of first contact with an attending physician, thus avoiding a face-to-face meeting and the risk of contracting the virus. A chatbot is able to qualify the patient, among other things, for an appropriate coronavirus test or referral to a doctor of a specific specialization. These tools are also finding more and more applications in psychology and psychiatry. On the basis of answers to a series of questions and a virtual interview, a preliminary working diagnosis is made and the result of the study allows for the identification of the clinicians most suitable for specific problems. For example, for a person struggling with sexual problems, where the context suggests an psychological aetiology, the application would suggest a sexologist.

A significant limitation of the above applications is the difficulty in determining the markers of the aetiology of the reported disorder. While the working diagnosis itself is relatively easy to introduce, in particular when it comes to the classification of several types of disorder (mood, anxiety, personality), an attempt to infer their aetiology on the basis of textual analysis alone is still impossible. Moreover, at the present stage of development of the technology, it is difficult to talk about the possibility of differentiating between individual units of mental disorders. This in fact is not the role assigned to programs of this type.

Conversations with patients can also take place as an element supporting the therapeutic process, thus complementing psychoeducation in the treatment of disorders [28]. Currently, patients are often provided with materials the purpose of which is to help them understand the essence of their difficulties, and thus help them in the therapeutic process. Therapists can additionally use English-language applications for mobile phones, which allow users to familiarize themselves with materials dedicated to a specific therapy, bots, or with elements of monitoring the health of the application user.

The advantage of using this type of approach is, as it seems, the high level of substantive content and the ability to personalize feedback based on the patient’s symptoms and functioning. A significant limitation, however, is the therapist’s lack of control over the content presented in a given application; if the problem experienced by the patient is complex or unusual, they may not find this type of content in the application.

The results of research conducted in this trend are optimistic, and these technologies are still largely experimental in terms of clinical psychology and psychotherapy. So far, the observations on the acceptance and implementation of chatbots into the practice of supporting mental health are promising, but they cannot be fully transferred to the field of psychotherapeutic practice [29].

Large technological advances, in a relatively short time, give grounds to believe that it will soon be possible to develop algorithms that will enable, among other things, the rapid detection of incoherent speech that may indicate schizophrenia [30] or mood disorders [31]. Websites addressed to a specific group of recipients also deserve attention, for example bots detecting stress in adolescents [32].

RISKS ASSOCIATED WITH THE USE OF MACHINE LEARNING METHODS TO SUPPORT THE THERAPEUTIC PROCESS

The previous section defined the main directions of development of machine learning applications in supporting the therapeutic process. Next, the problems related to the introduction of the above solutions to clinical practice, which relate basically to all of the cited solutions, will be presented.

Particular attention should be paid to ensuring the full privacy of applications used [33]. Due to the collection of health data, including mental health data, as well as other data such as location and vital signs, application producers must be responsible for their proper use. However, it is difficult to exclude the possibility of data leakage in this area, which could have negative consequences for their users.

Great emphasis should be placed on teaching psychologists and psychology students in formal education on how AI/ML-enabled tools might impact psychotherapy [34]. Selling user data to certain third parties³, such as those that sell certain medications or dietary supplements, would be ethically questionable. In addition, it could lead to the belief in the user that, on the basis of the information provided by him, the authors of the application (who very often collaborate with clinicians) recommend a specific type of substance when it would be visible only for marketing reasons.

It is difficult to define the extent to which the content of the programs based on machine learning or artificial intelligence is the result of cooperation with clinicians, but it seems that the largest applications place a lot of emphasis on this aspect. On the other hand, there are no legal regulations (or a system of recommendations of relevant scientific societies) that would limit the use of proven applications to support the therapeutic process of a given disorder in the future, and which were created solely for the financial purposes of authors who did not conduct substantive consultations. The above could lead to the use of inappropriate applications resembling those recommended by the clinician in appearance or name.

Work on artificial neural networks has revealed one more important phenomenon – that of so-called catastrophic forgetfulness. These networks, in learning to solve subsequent tasks, may lose the ability to perform those that they mastered earlier [35]. Work on solving this problem is ongoing, but neural network developers must remember that the new information memorization scheme should be programmed to avoid “overwriting” new information in the same structure.

At this point, it is not easy to assess the extent to which the introduction of machine learning methods will contribute to the actual support of therapeutic processes. While solutions introduced and tested so far seem to be very promising, it seems that at the moment there is a lack of adequate scientific research. A base of independent scientific research is required, leading to a comparison of interventions supported by a given application and technological solutions for therapeutic interventions with “classic” psychoeducation.

CONCLUSIONS

Machine learning methods are finding new applications in supporting therapeutic processes. They allow for timely responses, making the notifications sent to their users more relevant to their current needs. They make it possible to modify computer programs used for therapeutic purposes in a manner adapted to the experiences of a given patient and to react in real time to the changing conditions of therapy. They also make it possible to conduct conversations regarding reported symptoms by means of messages sent not to a human, but to a bot analysing the text sent to it in real time. All the above solutions, before they are recommended to support the therapeutic process, should be the subject of independent scientific research, which would allow for the evaluation of their actual usefulness. At the moment, it seems most important for clinical practice to raise the awareness of psychiatrists and clinical psychologists around solutions of this type, because some patients can already use them themselves. In such a case, it would be useful to know about the basics of the application’s operation and about the potential risks associated with its use.

Conflict of interest

Absent.

Financial support

Absent.

Notes

[1] Virtual reality is obtained by putting a special device on the patient’s head, in which he or she “moves” to the world created in a given program. This world is completely independent of the real world. Augmented reality is obtained by “superimposing” a virtual image on reality, for example by filming the room with the mobile phone and then superimposing it in real time with an image of the object that arouses fear.

[2] Due to copyright reasons, it was decided not to describe the actual operation of one of the therapeutic programs, but a similar clinical situation is described.

[3] Even assuming that the data would be shared legally, i.e. in accordance with the user’s statement of consent to share anonymised data with third parties.

References

Sochor, J. Fully automated real-time vehicles detection and tracking with lanes analysis. Proceedings of CESCG 2014: The 18^th Central European Seminar on Computer Graphics; 2014.

Pruś D, Stoma M, Dudziak A. Ocena świadomości wpływu sztucznej inteligencji na życie konsumentów. In: Wybrane zagadnienia z zakresu przemysłu spożywczego oraz zarządzania i inżynierii produkcji. Babicz M, Kropiwiec-Domańska K (eds.). Lublin: Uniwersytet Przyrodniczy w Lublinie; 2020.

Żurek J. Wybrane metody oceny bezpieczeństwa w lotnictwie. Problemy Eksploatacji 2009; 4: 61-70.

Laskoski PB, Serralta FB, Passos IC, Hauck S. Machine-learning approaches in psychotherapy: a promising tool for advancing the understanding of the psychotherapeutic process. Braz J Psychiatry 2019; 41: 568-569.

Meinlschmidt G, Tegethoff M, Belardi A, Stalujanis E, Oh M, Kyung Jung E, et al. Personalized prediction of smartphone-based psychotherapeutic micro-intervention success using machine learning. J Affect Disord 2020; 264: 430-437.

Vieira S, Liang X, Guiomar R, Mechelli A. Can we predict who will benefit from cognitive-behavioural therapy? A systematic review and meta-analysis of machine learning studies. Clin Psychol Rev 2022; 97: 102193. DOI: 10.1016/j.cpr.2022.102193.

Bełda A. 7 gier, które mogą ci pomóc w czasie depresji. Portal: gry-online.pl (Accessed: 14.04.2020).

Merry S, Stasiak K, Shepherd M, Frampton C, Fleming T, Lucassen M. The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial. BMJ 2012; 344: e2598. DOI: 10.1136/bmj.e2598.

Miner AS, Shah N, Bullock KD, Arnow BA, Bailenson J, Hancock J. Key considerations for incorporating conversational AI in psychotherapy. Front Psychiatry 2019; 10: 746. DOI: 10.3389/fpsyt.2019.00746.

Lake BM, Ullman TD, Tenenbaum JB, Gershman SJ. Building machines that learn and think like people. Behav Brain Sci 2017; 40: e253. DOI: 10.1017/S0140525X16001837.

Trzęsicki K. Idea Sztucznej Inteligencji. Filozofia i Nauka 2020; 8.

Horn RL, Weisz JR. Can artificial intelligence improve psychotherapy research and practice? Adm Policy Ment Health 2020; 47: 852-855.

Obermeyer Z, Emanuel EJ. Predicting the future–big data, machine learning, and clinical medicine. N Engl J Med 2016; 375: 1216-1219.

Schröder-Pfeifer P. Machine learning applications in psychotherapy research. Universitätbibliothek Heidelberg; 2022.

Díez J, Pérez-Núñez P, Luaces O, Remeseiro B, Bahamonde A. Towards explainable personalized recommendations by learning from users’ photos. Information Sciences 2020; 520: 416-430.

Yegnanarayana B. Artificial Neural Networks. Delhi: PHI Learning Pvt. Ltd.; 2009.

Kwasigroch A, Grochowski M. Rozpoznawanie obiektów przez głębokie sieci neuronowe. Zeszyty Naukowe Wydziału Elektrotechniki i Automatyki Politechniki Gdańskiej 2018; 60: 63-66.

Weiss G, Timko J, Gallagher C, Yoneda K, Schreiber A. Smartwatch-based activity recognition: a machine learning approach. IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI); 2016.

Fozoonmayeh D, Vu Le H, Wittfoth E, Geng C, Ha N, Wang J, et al. Myung-kyung Woodbridge D. A scalable smart-watch-based medication intake detection system using distributed machine learning. J Med Syst 2020; 44: 76. DOI: 10.1007/s10916-019-1518-8.

Luxton DD. An introduction to artificial intelligence in behavioral and mental health care. In: Artificial Intelligence in Behavioral and Mental Health Care. Luxton DD (ed.). Elsevier Academic Press; 2016, p. 1-26.

Martínez-Miranda J. Embodied conversational agents for the detection and prevention of suicidal behaviour: current applications and open challenges. J Med Syst 2017; 41: 135. DOI: 10.1007/s10916-017-0784-6.

Suyo MV, Núñez-Torres P. Virtual reality therapy for agoraphobic outpatients in Lima, Peru. Eur Psychiatry 2016; 33: 397-398.

McMahon E. Virtual reality exposure therapy: bringing ‘in vivo’ into the office. J Health Serv Psychol 2017; 43: 46-49.

Miner AS, Milstein A, Hancock JT. Talking to machines about personal mental health problems. JAMA 2017; 318: 1217-1218.

Crutzen R, Peters GJY, Portugal SD, Fisser EM, Grolleman JJ. An artificially intelligent chat agent that answers adolescents’ questions related to sex, drugs, and alcohol: an exploratory study. J Adolesc Health 2011; 48: 514-519.

Bickmore T, Gruber A, Picard R. Establishing the computer–patient working alliance in automated health behavior change interventions. Patient Educ Couns 2005; 59: 21-30.

Rizzo A, Scherer S, DeVault D, Gratch J, Artstein R, Hartholt A, et al. Detection and computational analysis of psychological signals using a virtual human interviewing agent. J Pain Manage 2016; 9: 311-321.

Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Ment Health 2017; 4: e19. DOI: 10.2196/mental.7785.

Bendig E, Erb B, Schulze-Thuesing L, Baumeister H. The next generation: chatbots in clinical psychology and psychotherapy to foster mental health–a scoping review. Verhaltenstherapie 2019. DOI: 10.1159/000501812.

Iter D, Yoon J, Jurafsky D. Automatic detection of incoherent speech for diagnosing schizophrenia. In: Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic. New Orleans, LA: Association for Computational Linguistics; 2018, p. 136-146.

Oh KJ, Lee D, Ko B, Choi HJ. A chatbot for psychiatric counseling in mental healthcare service based on emotional dialogue analysis and sentence generation. In: 2017 18^th IEEE International Conference on Mobile Data Management (MDM). Daejeon: IEEE; 2019, p. 371-375.

Huang J, Li Q, Xue Y, Cheng T, Xu S, Jia J, Feng L. Teenchat: a chatterbot system for sensing and releasing adolescents’ stress. In: International Conference on Health Information Science. Cham: Springer; 2015, p. 133-145.

Luxton DD. Recommendations for the ethical use and design of artificial intelligent care providers. Artif Intell Med 2014; 62: 1-10.

Blease C, Kharko A, Annoni M, Gaab J, Locher C. Machine learning in clinical psychology and psychotherapy education: a mixed methods pilot survey of postgraduate students at a Swiss University. Front Public Health 2021; 9: 623088. DOI: 10.3389/fpubh.2021.623088.

Mader P. Wykorzystanie sieci przestrzennych oraz metody potencjału w problemie katastroficznego zapominania. Kraków: Repozytorium Uniwersytetu Jagiellońskiego; 2020.

This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0). License allowing third parties to download and share its works but not commercially purposes or to create derivative works.