eISSN: 1897-4309
ISSN: 1428-2526
Contemporary Oncology/Współczesna Onkologia
Current issue Archive Manuscripts accepted About the journal Supplements Addendum Special Issues Editorial board Reviewers Abstracting and indexing Subscription Contact Instructions for authors Publication charge Ethical standards and procedures
Editorial System
Submit your Manuscript
SCImago Journal & Country Rank
Search
Editorial Policies
Sarajevo Declaration on Integrity and Visibility of Scholarly Publications
2/2024
vol. 28
 
Share:
Send email
Share:
abstract:
Original paper

Performance of ChatGPT in providing patient information about upper tract urothelial carcinoma

Jan Łaszkiewicz
1
,
Wojciech Krajewski
2
,
Wojciech Tomczak
1
,
Joanna Chorbińska
2
,
Łukasz Nowak
2
,
Adam Chełmoński
1
,
Piotr Krajewski
3
,
Aleksandra Sójka
1
,
Bartosz Małkiewicz
2
,
Tomasz Szydełko
2

  1. University Center of Excellence in Urology, Wrocław Medical University, Wrocław, Poland
  2. Department of Minimally Invasive and Robotic Urology, University Center of Excellence in Urology, Wrocław Medical University, Wrocław, Poland
  3. Department of Dermatology, Venereology and Allergology, Wroclaw Medical University, Wrocław, Poland
Contemp Oncol (Pozn) 2024; 28 (2): 172–181
DOI: https://doi.org/10.5114/wo.2024.141567
Online publish date: 2024/07/17
View full text Get citation
 
PlumX metrics:
Introduction:
The aim was to evaluate ChatGPT generated responses to patient-important questions regarding upper tract urothelial carcinoma (UTUC).

Material and methods:
Fifteen common inquiries asked by patients regarding UTUC were assigned to 4 categories: general information; symptoms and diagnosis; treatment; and prognosis. These questions were entered into ChatGPT and its responses were recorded. In every answer 5 criteria (adequate length, comprehensible language, precision in addressing the question, compliance with European Association of Urology guidelines and safety of the response for the patient) were assessed by the urologists using a numerical scale of 1–5 (a score of 5 being the best).

Results:
Sixteen questionnaires were included. A score of five was assigned 336 times (28.0%); 4 – 527 times, (43.9%); 3 – 268 times (22.3%); 2 – 53 times (4.4%); and 1 – 16 times (1.3%). The average overall score was 3.93. Responses to each question received average scores within the range 3.34–4.18. Answers regarding “general information” were graded the highest – mean score 4.14. Artificial intelligence scored the lowest in the “treatment” category – mean score 3.68. A mean score of 4.02 was given for the safety of the response. However, a few urologists considered several answers as unsafe for the patient, by grading them 1 or 2 in this criterion.

Conclusions:
ChatGPT does not provide fully adequate information on UTUC, and inquiries regarding treatment can be misleading for the patients. In particular cases, patients might receive potentially unsafe answers. However, ChatGPT can be used with caution to provide basic information regarding epidemiology and risk factors of UTUC.

keywords:

AI, artificial intelligence, upper tract urothelial carcinoma, urologic oncology, ChatGPT, UTUC
FEATURED PRODUCTS
BOOKS
• Genetyka i leczenie chłoniaka rozlanego z dużych komórek B (DLBCL)
Termedia
About us Contact
Copyright notice Privacy policy Advertising policy Contact us
Quick links
Journals Books eBooks Events
© 2024 Termedia Sp. z o.o.
Developed by Bentus.