The Times Australia
The Times World News

.
The Times Real Estate

.

We asked ChatGPT and Dr Google the same questions about cancer. Here's what they said

  • Written by Ashley M Hopkins, NHMRC Investigator Fellow, leader of the Clinical Cancer Epidemiology Lab, Flinders University
We asked ChatGPT and Dr Google the same questions about cancer. Here's what they said

You may have heard the buzz about ChatGPT[1], a type of chatbot that uses artificial intelligence (AI) to write essays, turn computer novices into programmers and help people communicate[2].

ChatGPT might also have a role in helping people make sense of medical information.

Although ChatGPT won’t replace talking to your doctor any time soon, our new research[3] shows its potential to answer common questions about cancer.

Here’s what we found when we asked the same questions to ChatGPT and Google. You might be surprised by the results.

Read more: Dr Google probably isn't the worst place to get your health advice[4]

What’s ChatGPT got to do with health?

ChatGPT has been trained on massive amounts of text data to generate conversational responses to text-based queries.

ChatGPT represents a new era of AI technology, which will be paired with[5] search engines, including Google and Bing, to change the way we navigate information online. This includes the way we search for health information.

For instance, you can ask ChatGPT questions like “Which cancers are most common?” or “Can you write me a plain English summary of common cancer symptoms you shouldn’t ignore”. It produces fluent and coherent responses. But are these correct?

Read more: Bard, Bing and Baidu: how big tech's AI race will transform search – and all of computing[6]

We compared ChatGPT with Google

Our newly published research[7] compared how ChatGPT and Google responded to common cancer questions.

These included simple fact-based questions like “What exactly is cancer?” and “What are the most common cancer types?”. There were also more complex questions about cancer symptoms, prognosis (how a condition is likely to progress) and side effects of treatment.

To simple fact-based queries, ChatGPT provided succinct responses similar in quality to the feature snippet[8] of Google. The feature snippet is “the answer” Google’s algorithm highlights at the top of the page.

While there were similarities, there were also broad differences between ChatGPT and Google replies. Google provided easily visible references (links to other websites) with its answers. ChatGPT gave different answers when asked the same question multiple times.

Woman in lounge room coughing into fist
Is coughing a sign of lung cancer? Shutterstock[9]

We also evaluated the slightly more complex question: “Is coughing a sign of lung cancer?”.

Google’s feature snippet indicated a cough that does not go away after three weeks is a main symptom of lung cancer.

But ChatGPT gave more nuanced responses. It indicated a long-standing cough is a symptom of lung cancer. It also clarified that coughing is a symptom of many conditions, and that a doctor would be required to get a proper diagnosis.

Our clinical team thought these clarifications were important. Not only do they minimise the likelihood of alarm, they also provide users clear directions on actions to take next – see a doctor.

How about even more complex questions?

We then asked a question about side-effects to a specific cancer drug: “Does pembrolizumab cause fever and should I go to the hospital?”.

We asked ChatGPT this five times and received five different responses. This is due to randomness built into ChatGPT, which may help communicate in a near human-like way, but will throw up multiple responses to the same question.

All five responses recommended speaking to a health-care professional. But not all said this was urgent or clearly defined how potentially serious this side-effect was. One response said fever was not a common side effect but did not explicitly say it could occur.

In general, we graded the quality of responses from ChatGPT to this question as poor.

Woman on sofa with towel one forehead and thermometer in hand Does pembrolizumab cause fever and should I go to the hospital? Shutterstock[10]

This contrasted with Google, which did not generate a featured snippet, likely due to the complexity of the question.

Instead, Google relied on users to find the necessary information. The first link directed them to the manufacturer’s product website. This source clearly indicated people should seek immediate medical attention if there was any fever with pembrolizumab.

Read more: ChatGPT has many uses. Experts explore what this means for healthcare and medical research[11]

What next?

We showed ChatGPT doesn’t always provide clearly visible references for its responses. It gives varying answers to a single given query and it is not kept up-to-date in real time. It can also produce incorrect responses[12] in a confident-sounding manner.

Bing’s new chatbot[13], which is different to ChatGPT and was released since our study, has a much clearer and more reliable process to outline reference sources and it aims to keep as up-to-date as possible. This shows how quickly this type of AI technology is developing and that the availability of progressively more advanced AI chatbots is likely to grow substantially.

However, in the future, any AI used as a health-care virtual assistant will need to be able to communicate any uncertainty about its responses rather than make up an incorrect answer, and consistently produce reliable responses.

We need to develop minimum quality standards for AI interventions in health care. This includes ensuring they generate evidence-based[14] information.

We also need to assess how AI virtual assistants are implemented[15] to make sure they improve people’s health[16] and don’t have any unexpected consequences[17].

There’s also the potential for medically focused AI assistants to be expensive[18], which raises questions of equity[19] and who has access to these rapidly developing technologies.

Last of all, health-care professionals need to be aware of[20] such AI innovations to be able to discuss their limitations with patients.

Ganessan Kichenadasse, Jessica M. Logan and Michael J. Sorich co-authored the original research paper mentioned in this article.

References

  1. ^ ChatGPT (openai.com)
  2. ^ help people communicate (theconversation.com)
  3. ^ our new research (academic.oup.com)
  4. ^ Dr Google probably isn't the worst place to get your health advice (theconversation.com)
  5. ^ will be paired with (theconversation.com)
  6. ^ Bard, Bing and Baidu: how big tech's AI race will transform search – and all of computing (theconversation.com)
  7. ^ newly published research (academic.oup.com)
  8. ^ feature snippet (support.google.com)
  9. ^ Shutterstock (www.shutterstock.com)
  10. ^ Shutterstock (www.shutterstock.com)
  11. ^ ChatGPT has many uses. Experts explore what this means for healthcare and medical research (theconversation.com)
  12. ^ incorrect responses (openai.com)
  13. ^ Bing’s new chatbot (blogs.bing.com)
  14. ^ evidence-based (onlinelibrary.wiley.com)
  15. ^ implemented (www.nature.com)
  16. ^ improve people’s health (www.nature.com)
  17. ^ unexpected consequences (onlinelibrary.wiley.com)
  18. ^ expensive (www.nature.com)
  19. ^ equity (www.nature.com)
  20. ^ aware of (www.nature.com)

Read more https://theconversation.com/we-asked-chatgpt-and-dr-google-the-same-questions-about-cancer-heres-what-they-said-201474

The Times Features

How to Treat Hair Loss Without a Hair Transplant

Understanding Hair Loss Hair loss can significantly affect individuals, both physically and emotionally. Identifying the causes and types can help address the issue more effecti...

How to Find a Trustworthy Professional for Your Plumbing Needs

Nowra is an idyllic locality often referred to as the city of the Shoalhaven City Council in the South Coast region of New South Wales, Australia. This picturesque suburb feature...

How to Choose a Mattress for Back/Neck Pain and All Sleepers?

Waking up with a stiff neck or aching back can derail your entire day. If you're one of the millions struggling with chronic pain, a supportive mattress is more than a luxury – i...

What to Look for in a Professional Debt Collection Service

Often in life, overdue payments are accidental or caused by unusual circumstances. This can cause some temporary convenience, but everything carries on as usual. However, when th...

Be inspired by celeb home decor from across the globe

GET THE LOOK: INDULGE IN THE SAME INTERIOR AS YOUR FAVE CELEBS There is a reason that Denmark ranks the highest on the happiness scale worldwide, one word: Hygge. Hygge. Hygge is ...

Maximizing Space in Narrow Lot Homes: Smart Design Solutions

Urban housing markets continue to push homeowners toward smaller, narrower lots as land prices climb and city populations grow. These thin slices of real estate present unique de...

Times Magazine

Types of Software Consultants

In today's technology-driven world, businesses often seek the expertise of software consultants to navigate complex software needs. There are several types of software consultants, including solution architects, project managers, and user experienc...

CWU Assistive Tech Hub is Changing Lives: Win a Free Rollator Walker This Easter!

🌟 Mobility. Independence. Community. All in One. This Easter, the CWU Assistive Tech Hub is pleased to support the Banyule community by giving away a rollator walker. The giveaway will take place during the Macleod Village Easter Egg Hunt & Ma...

"Eternal Nurture" by Cara Barilla: A Timeless Collection of Wisdom and Healing

Renowned Sydney-born author and educator Cara Barilla has released her latest book, Eternal Nurture, a profound collection of inspirational quotes designed to support mindfulness, emotional healing, and personal growth. With a deep commitment to ...

How AI-Driven SEO Enhancements Can Improve Headless CMS Content Visibility

Whereas SEO (search engine optimization) is critical in the digital landscape for making connections to content, much of it is still done manually keyword research, metatags, final tweaks at publication requiring a human element that takes extensiv...

Crypto Expert John Fenga Reveals How Blockchain is Revolutionising Charity

One of the most persistent challenges in the charity sector is trust. Donors often wonder whether their contributions are being used effectively or if overhead costs consume a significant portion. Traditional fundraising methods can be opaque, with...

Navigating Parenting Arrangements in Australia: A Legal Guide for Parents

Understanding Parenting Arrangements in Australia. Child custody disputes are often one of the most emotionally charged aspects of separation or divorce. Parents naturally want what is best for their children, but the legal process of determining ...

LayBy Shopping