ChatGPT may help improve health outcomes for patients with cirrhosis and liver cancer by providing easy-to-understand information about basic knowledge, lifestyle and treatments for these conditions, new research has found.
The findings, published in the peer-reviewed journal Clinical and Molecular Hepatology, highlight the AI system’s potential to play a role in clinical practice.
Brennan Spiegel, MD, MSHS, director of Health Services Research at Cedars-Sinai and co-corresponding author of the study, said:
“Patients with cirrhosis and/or liver cancer and their caregivers often have unmet needs and insufficient knowledge about managing and preventing complications of their disease.
“We found ChatGPT—while it has limitations—can help empower patients and improve health literacy for different populations.”
Patients diagnosed with liver cancer and cirrhosis, an end-stage liver disease that is also a major risk factor for the most common form of liver cancer, often require extensive treatment that can be complex and difficult to manage.
Alexander Kuo, MD, medical director of Liver Transplantation Medicine at Cedars-Sinai and co-corresponding author of the study, said:
“The complexity of the care required for this patient population makes patient empowerment with knowledge about their disease crucial for optimal outcomes.
“While there are currently online resources for patients and caregivers, the literature available is often lengthy and difficult for many to understand, highlighting the limited options for this group.”
Personalised education AI models could help increase patient knowledge and education, Kuo noted.
One of those is ChatGPT, which stands for generative pre-trained transformer.
ChatGPT has quickly become popular for its human-like text in chatbot conversations where users can input any prompt and it will generate a response based on the information stored in its database.
The technology has already shown some potential for medical professionals by writing basic medical reports and correctly answering medical student examination questions.
Yee Hui Yeo, MD, first author of the study and a clinical fellow in the Karsh Division of Gastroenterology and Hepatology at Cedars-Sinai, said:
“ChatGPT has shown to be able to provide professional, yet highly comprehensible responses.
“However, this is one of the first studies to examine the ability of ChatGPT to answer clinically oriented, disease-specific questions correctly and compare its performance to physicians and trainees.”
To verify the accuracy of the AI model in its knowledge about both cirrhosis and liver cancer, researchers presented ChatGPT with 164 frequently asked questions in five categories.
The ChatGPT answers were then independently graded by two liver transplant specialists.
Each question was posed twice to the AI and was categorised as either basic knowledge, diagnosis, treatment, lifestyle or preventive medicine.
Study results include:
- ChatGPT answered about 77 per cent of the questions correctly, providing high levels of accuracy in 91 questions from a variety of categories.
- The specialists grading the responses said 75 per cent of the responses for basic knowledge, treatment and lifestyle were comprehensive or correct, but inadequate.
- The proportion of responses that were “mixed with correct and incorrect data” was 22 per cent for basic knowledge, 33 per cent for diagnosis, 25 per cent for treatment, 18 per cent for lifestyle and 50 per cent for preventive medicine.
The AI model also provided practical and useful advice to patients and caregivers about the next steps adjusting to a new diagnosis.
However, the study left no doubt that advice from a physician was superior.
Spiegel said:
“More research is still needed to better examine the tool in patient education, but we believe ChatGPT to be a very useful adjunctive tool for physicians—not a replacement—but adjunctive tool that provides access to reliable and accurate health information that is easy for many to understand.
“We hope that this can help physicians to empower patients and improve health literacy for patients facing challenging conditions such as cirrhosis and liver cancer.”
