The Times Australia
The Times World News

.
The Times Real Estate

.

Artificial intelligence is already in our hospitals. 5 questions people want answered

  • Written by Stacy Carter, Professor and Director, Australian Centre for Health Engagement, Evidence and Values, University of Wollongong
Artificial intelligence is already in our hospitals. 5 questions people want answered

Artificial intelligence (AI) is already being used in health care. AI can look for patterns in medical images[1] to help diagnose disease. It can help predict who in a hospital ward might deteriorate[2]. It can rapidly summarise[3] medical research papers to help doctors stay up-to-date with the latest evidence.

These are examples of AI making or shaping[4] decisions health professionals previously made. More applications are being developed.

But what do consumers think of using AI in health care? And how should their answers shape how it’s used in the future?

Read more: AI is already being used in healthcare. But not all of it is 'medical grade'[5]

What do consumers think?

AI systems are trained to look for patterns in large amounts of data. Based on these patterns, AI systems can make recommendations, suggest diagnoses, or initiate actions. They can potentially continually learn, becoming better at tasks over time.

If we draw together international[6] evidence, including our own[7] and that[8] of others[9], it seems most consumers accept the potential value of AI in health care.

This value could include, for example, increasing the accuracy of diagnoses[10] or improving access to care[11]. At present, these are largely potential, rather than proven, benefits.

But consumers say their acceptance is conditional. They still have serious concerns.

1. Does the AI work?

A baseline expectation is AI tools should work well. Often, consumers say AI should be at least as good as a human doctor[12] at the tasks it performs. They say we should not use AI if it will lead to more incorrect diagnoses or medical errors.

Read more: AI chatbots are still far from replacing human therapists[13]

2. Who’s responsible if AI gets it wrong?

Consumers also worry that if AI systems generate decisions – such as diagnoses or treatment plans – without human input, it may be unclear who is responsible for errors. So people often want clinicians to remain responsible for the final decisions, and for protecting patients[14] from harms.

Read more: Who will write the rules for AI? How nations are racing to regulate artificial intelligence[15]

3. Will AI make health care less fair?

If health services are already discriminatory[16], AI systems can learn these patterns from data and repeat or worsen[17] the discrimination. So AI used in health care can make health inequities worse. In our studies consumers said this is not OK[18].

4. Will AI dehumanise health care?

Consumers are concerned AI will take the “human” elements out of health care, consistently saying AI tools should support rather than replace[19] doctors. Often, this is because AI is perceived to lack important human traits, such as empathy[20]. Consumers say the communication skills, care and touch of a health professional are especially important when feeling vulnerable.

Read more: Chatbots for medical advice: three ways to avoid misleading information[21]

5. Will AI de-skill our health workers?

Consumers value human clinicians and their expertise. In our research with women[22] about AI in breast screening, women were concerned about the potential effect on radiologists’ skills and expertise. Women saw this expertise as a precious shared resource: too much dependence on AI tools, and this resource might be lost.

Consumers and communities need a say

The Australian health-care system cannot focus only on the technical elements of AI tools. Social and ethical considerations, including high-quality engagement with consumers and communities, are essential to shape AI use in health care.

Communities need opportunities to develop digital health literacy[23]: digital skills[24] to access reliable, trustworthy health information, services and resources.

Respectful engagement with Aboriginal and Torres Strait Islander communities must be central. This includes upholding Indigenous data sovereignty, which the Australian Institute of Aboriginal and Torres Strait Islander Studies describes as[25]:

the right of Indigenous peoples to govern the collection, ownership and application of data about Indigenous communities, peoples, lands, and resources.

This includes any use of data to create AI.

First Nations people in meeting at conference table, laptop open
Respectful engagement with Aboriginal and Torres Strait Islander communities is vital. Thurtell/GettyImages

This critically important consumer and community engagement needs to take place before managers design (more) AI into health systems, before regulators[26] create guidance for how AI should and shouldn’t be used, and before clinicians consider buying a new AI tool for their practice.

We’re making some progress. Earlier this year, we ran a citizens’ jury on AI in health care[27]. We supported 30 diverse Australians, from every state and territory, to spend three weeks learning about AI in health care, and developing recommendations for policymakers.

Their recommendations, which will be published in an upcoming issue of the Medical Journal of Australia, have informed a recently released national roadmap[28] for using AI in health care.

Read more: Worried about AI? You might have AI-nxiety – here's how to cope[29]

That’s not all

Health professionals also need to be upskilled and supported to use AI in health care. They need to learn to be critical users of digital health tools, including understanding their pros and cons.

Our analysis[30] of safety events reported to the Food and Drug Administration shows the most serious harms reported to the US regulator came not from a faulty device, but from the way consumers and clinicians used the device.

We also need to consider when health professionals should tell patients an AI tool is being used in their care, and when health workers should seek informed consent for that use.

Lastly, people involved in every stage of developing and using AI need to get accustomed to asking themselves: do consumers and communities agree this is a justified use of AI?

Only then will we have the AI-enabled health-care system consumers actually want.

References

  1. ^ medical images (journal.achsm.org.au)
  2. ^ deteriorate (www.jmir.org)
  3. ^ rapidly summarise (elicit.com)
  4. ^ or shaping (theconversation.com)
  5. ^ AI is already being used in healthcare. But not all of it is 'medical grade' (theconversation.com)
  6. ^ international (www.sciencedirect.com)
  7. ^ our own (www.uow.edu.au)
  8. ^ and that (journal.achsm.org.au)
  9. ^ of others (humanfactors.jmir.org)
  10. ^ accuracy of diagnoses (www.jmir.org)
  11. ^ access to care (mental.jmir.org)
  12. ^ human doctor (journal.achsm.org.au)
  13. ^ AI chatbots are still far from replacing human therapists (theconversation.com)
  14. ^ protecting patients (www.nature.com)
  15. ^ Who will write the rules for AI? How nations are racing to regulate artificial intelligence (theconversation.com)
  16. ^ already discriminatory (theconversation.com)
  17. ^ repeat or worsen (www.science.org)
  18. ^ is not OK (journals.sagepub.com)
  19. ^ support rather than replace (journals.sagepub.com)
  20. ^ such as empathy (journals.sagepub.com)
  21. ^ Chatbots for medical advice: three ways to avoid misleading information (theconversation.com)
  22. ^ research with women (journals.sagepub.com)
  23. ^ digital health literacy (theconversation.com)
  24. ^ digital skills (www.goodthingsfoundation.org.au)
  25. ^ describes as (aiatsis.gov.au)
  26. ^ regulators (theconversation.com)
  27. ^ citizens’ jury on AI in health care (www.uow.edu.au)
  28. ^ national roadmap (aihealthalliance.org)
  29. ^ Worried about AI? You might have AI-nxiety – here's how to cope (theconversation.com)
  30. ^ analysis (pubmed.ncbi.nlm.nih.gov)

Read more https://theconversation.com/artificial-intelligence-is-already-in-our-hospitals-5-questions-people-want-answered-217374

The Times Features

Why Regional Small Businesses in Bendigo Deserve Better Access to Finance in 2025

In the heart of regional Victoria, Bendigo has long stood as a beacon of innovation, resilience and community spirit. As we step further into 2025, the importance of nurturing sm...

Is It Time for a Deep Cleaning? Signs You Shouldn’t Ignore

Most people know they should visit the dentist for a regular check-up and cleaning every six months. But sometimes, a standard cleaning isn’t enough. When plaque and tartar build...

The Hidden Meaning Behind Popular Engagement Ring Cuts

When it comes to engagement rings, the cut of the diamond is not just about aesthetics. Each shape carries its own symbolism and significance, making it an important decision for...

Annual Health Exams in the Office: How They Can Reduce Sick Days and Healthcare Costs

Regular health check-ups, especially annual health exams in the office, can significantly impact the overall well-being of your workforce. A proactive approach to employee health...

Best Deals on Home Furniture Online

Key Highlights Discover the best deals on high-quality outdoor furniture online. Transform your outdoor space into a stylish and comfortable oasis. Explore a wide range of d...

Discover the Best Women's Jumpers for Every Season

Key Highlights Explore lightweight jumpers for spring and summer, ensuring breathability and ease. Wrap up warm with cozy wool jumpers for the chilly autumn and winter season...

Times Magazine

The Essential Guide to Transforming Office Spaces for Maximum Efficiency

Why Office Fitouts MatterA well-designed office can make all the difference in productivity, employee satisfaction, and client impressions. Businesses of all sizes are investing in updated office spaces to create environments that foster collaborat...

The A/B Testing Revolution: How AI Optimized Landing Pages Without Human Input

A/B testing was always integral to the web-based marketing world. Was there a button that converted better? Marketing could pit one against the other and see which option worked better. This was always through human observation, and over time, as d...

Using Countdown Timers in Email: Do They Really Increase Conversions?

In a world that's always on, where marketers are attempting to entice a subscriber and get them to convert on the same screen with one email, the power of urgency is sometimes the essential element needed. One of the most popular ways to create urg...

Types of Software Consultants

In today's technology-driven world, businesses often seek the expertise of software consultants to navigate complex software needs. There are several types of software consultants, including solution architects, project managers, and user experienc...

CWU Assistive Tech Hub is Changing Lives: Win a Free Rollator Walker This Easter!

🌟 Mobility. Independence. Community. All in One. This Easter, the CWU Assistive Tech Hub is pleased to support the Banyule community by giving away a rollator walker. The giveaway will take place during the Macleod Village Easter Egg Hunt & Ma...

"Eternal Nurture" by Cara Barilla: A Timeless Collection of Wisdom and Healing

Renowned Sydney-born author and educator Cara Barilla has released her latest book, Eternal Nurture, a profound collection of inspirational quotes designed to support mindfulness, emotional healing, and personal growth. With a deep commitment to ...

LayBy Shopping