HOW CHATGPT ANSWERS URINARY INCONTINENCE QUESTIONS: AN EXPLORATORY STUDY

Dear Editor,
There have been advances in artificial intelligence (AI) and deep learning in the last decade, and these technologies are becoming applicable in many industries such as healthcare. In November 2022, the nonprofit OpenAI Inc., an AI company based in San Francisco, California (USA) [1] developed the chatbot named ChatGPT. They claim that they have created an extremely popular application; a language-based interaction chatbot [1]. According to Hopkins et al., significant language models like ChatGPT are expected to fundamentally alter how patients inquire about their state of health [2]. Making recommendations like "make an appointment with a GP" or "go to the hospital" are given by the Babylon chatbot when used as a symptom checker in the UK [3]. A review emphasized the value of ChatGPT as a tool for healthcare professionals because of its capacity to generate text in natural language, summarize huge amounts of data, and provide particular answers, but also the necessity of keeping up with the most recent tools and methods [4]. In this context, it is believed that incorrect content development can have major detrimental effects on health services; healthcare practices place a strong emphasis on careful evaluation by healthcare specialists [5-7].
In the conducted research, we aimed to examine the answers given to urinary incontinence questions that we compiled from websites in order to evaluate the reliability and danger of the answers generated by ChatGPT. The questions about urine incontinence written by women on various websites were combined to make a total of 24 questions. Five faculty members (3 professors, 2 associate professors) who are experts in the field of urogynecology nursing rated the responses as "consistent" or "inconsistent" with a strong recommendation based on the best evidence in the guidelines. Each question was posed three times to ChatGPT-3.5 and ChatGPT-4. For each question, a score between 0 and 5 was assigned.
Evidence-based practice is “integrating the best available evidence with the expertise of the healthcare educator and the needs of the patient, while considering the practice setting” [8]. Although not customized for medical databases, ChatGPT responses received full marks from experts. However, experts agree that the answers they receive are limited to up until 2022 and do not include the latest medical information, as the updating of the answers to ChatGPT depends on the database. It...


View full text...