The Times Australia
The Times World News

.
The Times Real Estate

.

AI is already being used in healthcare. But not all of it is 'medical grade'

  • Written by Karin Verspoor, Dean, School of Computing Technologies, RMIT University, RMIT University
AI is already being used in healthcare. But not all of it is 'medical grade'

Artificial intelligence (AI) seems to be everywhere these days, and healthcare is no exception.

There are computer vision tools that can detect suspicious skin lesions[1] as well as a specialist dermatologist can. Other tools can predict coronary artery disease from scans[2]. There are also data-driven robots[3] that guide minimally-invasive surgery.

To precisely diagnose diseases[4] and guide treatment choices[5], AI is used to analyse patients’ genomic and molecular data. For instance, machine learning has been applied to detect Alzheimer’s disease[6] and to help choose the best antidepressant medication[7] for patients with major depression.

Deep learning[8] methods have been used to model electronic health record data to predict health outcomes for patients[9] and provide early estimates of treatment cost[10].

Read more: AI to Z: all the terms you need to know to keep up in the AI hype age[11]

With new language-based generative AI technologies like ChatGPT, the clinical world is abuzz with talk of chatbots for answering patient questions[12], helping doctors take better notes[13], and even explaining a diagnosis[14] to a concerned grandchild.

There is no doubt that in terms of patient health, workflows and system efficiency, AI will benefit the health system.

But there are legitimate concerns about the accuracy of such tools, including how well they work in new settings (such as a different country or even a different hospital from where they were created), and whether they “hallucinate” – or make things up.

An operating room with no people and only several robot arms hovering above a patient
Robot-assisted surgery is already the reality in some technologically equipped hospitals. Shutterstock[15]

Developing ‘medical grade’ tools

In our recent article[16] in the Medical Journal of Australia, we argue using AI effectively in healthcare will require retraining of the workforce, retooling health services, and transforming workflows.

Critically, we also need to collect evidence AI tools are “medical grade” before we use them on patients.

Many claims made by the developers of medical AI may lack appropriate scientific rigour[17] and evaluations of AI tools may suffer from a high risk of bias[18]. This means the tests run to ensure their accuracy are too narrow.

AI tools can make errors, or stop working when the application context changes. Conversational agents such as chatbots may produce misleading medical information that may delay patients seeking care. They may also make inappropriate recommendations[19].

All this means we need standards for the AI tools that impact diagnosis and treatment of patients. Clinicians should be given training on how to critically assess[20] AI applications to understand their readiness for routine care.

We should expect to be able to replicate the results from one context to another, under real-world conditions. For example, a tool developed using historical data from a hospital in New York should be carefully trialled with live patient data in Broome before we trust it.

Randomised controlled trials of AI tools, where these differences are controlled for, would represent a gold standard of evidence for their use.

Read more: AI has potential to revolutionise health care – but we must first confront the risk of algorithmic bias[21]

We can’t just copy what other countries do

It is important to carefully examine how AI tools are embedded into workflows[22] to support clinical decisions. The benefits and risks of a tool will depend on precisely how the human clinician and the tool work together[23].

There’s a view that all we need to do in Australia is adopt the best of what is produced internationally, and that we don’t need deep sovereign capabilities.

Perhaps we can rely on the regulation of AI tools under way through the European Union’s AI Act[24], or the United States Food and Drug Administration’s processes for assessing Software as a Medical Device[25].

Nothing is further from the truth.

AI requires local customisation to support local practices, and to reflect diverse populations or health service differences. We don’t want to just export our clinical datasets and import back the models built with them without adapting to our contexts and workflows. We need to monitor the clinical deployments of AI tools into our settings.

Without some degree of algorithmic sovereignty – the capability to produce or modify AI in Australia – the nation is exposed to new risks and the benefits of the technology will be limited.

Read more: How should Australia capitalise on AI while reducing its risks? It's time to have your say[26]

A roadmap for AI in Australian healthcare

The Australian Alliance for Artificial Intelligence in Healthcare has produced a roadmap[27] for future development.

It identifies gaps in Australia’s capability to translate AI into effective and safe clinical services and provides guidance on key issues such as workforce, industry capability, implementation, regulation, and cybersecurity.

These recommendations offer a path toward an AI-enabled Australian healthcare system capable of delivering personalised and patient-focused healthcare, safely and ethically.

The plan also envisages a vibrant AI industry sector that creates jobs and exports to the world, working side by side with an AI-aware workforce and AI-savvy consumers.

AI has the potential to transform medicine. It can do so by harnessing computational power to discern subtle patterns in complex data spanning biology, images, sensory and experiential data, and more.

With care and strategic investment, innovations in AI will surely benefit clinicians and patients alike. Now is the time to act to ensure Australia is well-placed to benefit from one of the most significant industrial revolutions of our time.

References

  1. ^ detect suspicious skin lesions (doi.org)
  2. ^ from scans (www.ahajournals.org)
  3. ^ data-driven robots (ieeexplore.ieee.org)
  4. ^ precisely diagnose diseases (doi.org)
  5. ^ treatment choices (doi.org)
  6. ^ Alzheimer’s disease (doi.org)
  7. ^ choose the best antidepressant medication (doi.org)
  8. ^ Deep learning (www.ibm.com)
  9. ^ predict health outcomes for patients (doi.org)
  10. ^ early estimates of treatment cost (doi.org)
  11. ^ AI to Z: all the terms you need to know to keep up in the AI hype age (theconversation.com)
  12. ^ chatbots for answering patient questions (dx.doi.org)
  13. ^ take better notes (www.nejm.org)
  14. ^ explaining a diagnosis (unlocked.microsoft.com)
  15. ^ Shutterstock (www.shutterstock.com)
  16. ^ recent article (doi.org)
  17. ^ lack appropriate scientific rigour (doi.org)
  18. ^ high risk of bias (doi.org)
  19. ^ inappropriate recommendations (doi.org)
  20. ^ critically assess (doi.org)
  21. ^ AI has potential to revolutionise health care – but we must first confront the risk of algorithmic bias (theconversation.com)
  22. ^ how AI tools are embedded into workflows (doi.org)
  23. ^ how the human clinician and the tool work together (doi.org)
  24. ^ AI Act (artificialintelligenceact.eu)
  25. ^ Software as a Medical Device (www.fda.gov)
  26. ^ How should Australia capitalise on AI while reducing its risks? It's time to have your say (theconversation.com)
  27. ^ a roadmap (aihealthalliance.org)

Read more https://theconversation.com/ai-is-already-being-used-in-healthcare-but-not-all-of-it-is-medical-grade-207912

The Times Features

Why You Need an Expert Electrician for Your Business’s Electrical Upgrades and Repairs

When it comes to maintaining and upgrading your business’s electrical systems, it’s essential to call in a professional. Electrical work in any commercial setting requires the ex...

Why Is It Crucial to Have a Building Inspection Done Before Buying a New Home?

Purchasing a new property is a big financial decision that can impact your future for years. Whether you are a first-time buyer or an investor, good or bad, it is essential to en...

Online Application for Sick Leave Certificate: Understanding When and How to Secure One

A sick leave certificate is an official document issued by a healthcare professional to verify an individual's inability to attend work due to illness. It typically includes the ...

A No-Fuss Guide to an Effective Beauty Routine

Taking care of the skin and appearance need not be complicated; it need not even consume your hours of time. Smart and simple approaches can give one that glow and fresh look witho...

Safe & Effective Tattoo Removal in Auckland – What You Need to Know

If you're looking for tattoo removal in Auckland, modern laser technology offers the safest and most effective way to fade or completely remove unwanted ink. Whether it's an outd...

Fleece-Lined Tights vs. Regular Tights: What’s the Difference?

When temperatures drop, choosing the right pair of tights can make a significant difference in comfort, warmth, and durability. Whether you wear tights for fashion, work, or outdoo...

Times Magazine

The Ultimate Guide to Apple Watch Faces & Trending Wallpapers

In today’s digital world, personalization is everything. Your smartwatch isn’t just a timepiece—it’s an extension of your style. Thanks to innovative third-party developers, customizing your Apple Watch has reached new heights with stunning designs...

The Power of Digital Signage in Modern Marketing

In a fast-paced digital world, businesses must find innovative ways to capture consumer attention. Digital signage has emerged as a powerful solution, offering dynamic and engaging content that attracts and retains customers. From retail stores to ...

Why Cloud Computing Is the Future of IT Infrastructure for Enterprises

Globally, cloud computing is changing the way business organizations manage their IT infrastructure. It offers cheap, flexible and scalable solutions. Cloud technologies are applied in organizations to facilitate procedures and optimize operation...

First Nations Writers Festival

The First Nations Writers Festival (FNWF) is back for its highly anticipated 2025 edition, continuing its mission to celebrate the voices, cultures and traditions of First Nations communities through literature, art and storytelling. Set to take ...

Improving Website Performance with a Cloud VPS

Websites represent the new mantra of success. One slow website may make escape for visitors along with income too. Therefore it's an extra offer to businesses seeking better performance with more scalability and, thus represents an added attracti...

Why You Should Choose Digital Printing for Your Next Project

In the rapidly evolving world of print media, digital printing has emerged as a cornerstone technology that revolutionises how businesses and creative professionals produce printed materials. Offering unparalleled flexibility, speed, and quality, d...

LayBy Shopping