By The ASCO Post Staff
Posted: 4/4/2023 12:48:00 PM
Last Updated:
Researchers have shown that the artificial intelligence chatbot ChatGPT can help improve health outcomes for patients with cirrhosis and hepatic cancer by providing easy-to-understand information about basic science, lifestyle modifications and treatment options for these conditions; from a new study by Yeo et al. Clinical and molecular hepatology.
The new findings highlight the potential of ChatGPT to play a role in clinical practice.
Background
“Patients with cirrhosis and/or” [hepatic] Cancer patients and their caregivers often need and lack necessary knowledge about managing and preventing the complications of their disease, “explained the study’s co-corresponding author.” Brennan Spiegel, MD, MSHSProfessor of Medicine at the David Geffen School of Medicine at the University of California, Los Angeles and Director of Health Services Research at Cedars-Sinai Medical Center.
Patients diagnosed with liver cancer and cirrhosis often require extensive treatment, which can be complex and difficult to manage.
“The complex care requirements of this patient population make [empowering patients] with knowledge of the disease at risk for optimal outcomes, “underscored author co-respondent” Alexander Kuo, MD, Professor of Medicine and Medical Director of Liver Transplant Medicine at Cedars-Sinai Medical Center. “While there are online resources for patients and caregivers, the literature available is often lengthy and difficult for many to understand, highlighting the limited options for this group,” he added.
The researchers highlighted that personal education AI models such as ChatGPT help to increase patient knowledge.
The new chatbot – which stands for generative preset transformer – has quickly become popular for human conversations like text, where users can prompt someone to generate a response based on information stored in their databases.
He has already demonstrated some potential in writing basic medical reports to medical professionals and correctly answering questions from medical students.
“ChatGPT has shown that it can provide professional, yet highly intelligent responses,” explained the study’s first author You Hui Yeo, MDa clinical research fellow in the Karsh Division of Gastroenterology and Hepatology at Cedars-Sinai Medical Center. “However, this is the first study to examine the ability of ChatGPT to answer oriented, disease-specific questions correctly and to compare its effectiveness to clinicians and trainees.”
“We found that ChatGPT – while it has limitations – can help patients and improve health literacy for different populations,” explained Dr.
Study Methods and Results
In a new study, ChatGPT researchers repeatedly asked 164 questions in five categories to evaluate the accuracy of the chatbot’s knowledge of both cirrhosis and liver cancer. ChatGPT responses were then independently graded by two liver transplant experts.
Each question has been submitted twice to ChatGPT and is in general or basic science, diagnosis, treatment, lifestyle, or preventive medicine.
After completing the study, the researchers reported;
- ChatGPT answered about 77% of questions correctly, while giving high accuracy rates for 91 questions from various categories.
- Grading the responses, the specialists noted that 75% of the responses to knowledge, treatment and lifestyle were “comprehensive” or “correct but inadequate”.
- The proportion of responses that were given as “mixed correct and incorrect” was 22% for basic knowledge, 33% for diagnosis, 25% for treatment, 18% for lifestyle, and 50% for preventive medicine.
ChatGPT also provides practical and helpful advice to patients and caregivers about the next steps in adjusting to a new diagnosis.
conclusion
And the researchers confirmed, the study left no doubt that the doctor’s advice from ChatGPT was in charge of the decision.
“Although the model was able to demonstrate a strong ability in the basic fields of knowledge, lifestyle and care, it suffered from the ability to formulate recommendations according to the regions where the seeker lived,” explained Dr. Yes. “This is most likely due to various recommendations [the hepatic] Cancer monitoring intervals and symptoms are reported by different professional societies. But we hope that they will be more careful in addressing the questions according to the position of the investigators [in the future].
“More research is still needed to better examine the tool in patient education, but we believe that ChatGPT is a very useful adjunctive tool for doctors, not a replacement, but [one] which provides access to reliable and accurate health information that is easy for many to understand. We hope that this can help doctors to help patients and to improve the health literature for patients against challenging conditions such as cirrhosis and [hepatic] cancer,” Dr. Spiegel concluded.
Open: For full disclosure of the study authors, visit e-cmh.org.
The content in this post has not been reviewed by the American Society of Clinical Oncology, Inc.
