The Times Australia
The Times World News

.
The Times Real Estate

.

how to fix Australia's broken NHMRC medical research funding system

  • Written by Tony Blakely, Professor of Epidemiology, Population Interventions Unit, Centre for Epidemiology and Biostatistics, Melbourne School of Population and Global Health, The University of Melbourne
how to fix Australia's broken NHMRC medical research funding system

Most health research in Australia is funded by the National Health and Medical Research Council (NHMRC), which distributes around $800 million each year[1] through competitive grant schemes. An additional $650 million a year is funded via the Medical Research Future Fund[2], but this focuses more on big-picture “missions” than researcher-initiated projects.

Ten years ago, around 20% of applications for NHMRC funding were successful. Now, only about 10–15% are approved.

Over the same ten-year period, NHMRC funding has stayed flat while prices and population have increased. In inflation-adjusted and per capita terms, the NHMRC funding available has fallen by 30%.

As growing numbers of researchers compete for dwindling real NHMRC funding, research risks becoming “a high-status gig economy[3]”. To fix it, we need to spend more on research – and we need to spend it smarter.

More funding

To keep pace with other countries, and to keep health research a viable career, Australia first of all needs to increase the total amount of research funding.

Between 2008 and 2010, Australia matched the average among OECD countries of investing 2.2% of GDP in research and development. More recently, Australia’s spending has fallen to 1.8%, while the OECD average[4] has risen to 2.7%.

Read more: COVID has left Australia's biomedical research sector gasping for air[5]

When as few as one in ten applications is funded, there is a big element of chance in who succeeds.

Think of it like this: applications are ranked in order from best to worst, and then funded in order from the top down. If a successful application’s ranking is within say five percentage points of the funding cut-off, it might well have missed out if the assessment process were run again – because the process is always somewhat subjective and will never produce exactly the same results twice.

So 5% of the applications are “lucky” to get funding. When only 10% of applications get funding, that means half of the successful ones were lucky. But if there is more money to go around and 20% of applicants are funded, the lucky 5% are only a quarter of the successful applicants.

This is a simplistic explanation, but you can see that the lower the percentage of grants funded, the more of a lottery it becomes.

This increasing element of “luck” is demoralising for the research workforce of Australia, leading to depletion of academics and brain drain.

The ‘application-centric’ model

As well as increasing total funding, we need to look at how the NHMRC allocates these precious funds.

In the past five years, the NHMRC has moved to a system called “application-centric” funding. Five (or so) reviewers are selected for each grant and asked to independently score applications.

There are usually no panels for discussion and scoring of applications – which is what used to happen.

The advantages of application-centric assessment include (hopefully) getting the best experts on a particular grant to assess it, and a less logistically challenging task for the NHMRC (convening panels is hard work and time-consuming).

However, application-centric assessment has disadvantages.

First, assessor reviews are not subject to any scrutiny. In a panel system, differences of opinion and errors can be managed through discussion.

Second, many assessors will be working in a “grey zone”. If you are expert in the area of a proposal, and not already working with the applicants, you are likely to be competing with them for funding. This may result in unconscious bias or even deliberate manipulation of scores.

And third, there is simple “noise”. Imagine each score an assessor gives is made up of two components: the “true score” an application would receive on some unobservable gold standard assessment, plus or minus some “noise” or random error. That noise is probably half or more of the current variation between assessor scores.

Smarter scoring

So how do we reduce the influence of both assessor bias and simple “noise”?

First, assessor scores need to be “standardised” or “normalised”. This means rescaling all assessors’ scores to have the same mean (standardisation) or same mean and standard deviation (normalisation).

Read more: The NHMRC program grant overhaul: will it change the medical research landscape in Australia?[6]

This is a no-brainer. You can use a pretty simple Excel model (I have done it) to show this would substantially reduce the noise.

Second, the NHMRC could use other statistical tools to reduce both bias and noise.

One method would be to take the average ranking of applications across five methods:

  • with the raw scores (i.e. as done now)
  • with standardised scores
  • with normalised scores
  • dropping the lowest score for each application
  • dropping the highest score for each application.

The last two “drop one score” methods aim to remove the influence of potentially biased assessors.

The applications that make the cutoff rank on all the methods are funded. Those that are always beneath the threshold are not funded.

Applications that make the cut on some tests but fail on others could be sent out for further scrutiny – or the NHMRC could judge them by their average rank across the five methods.

This proposal won’t fix the problem with the total amount of funding available, but it would make the system fairer and less open to game-playing.

A less noisy and fairer system

Researchers know any funding system contains an element of chance. One study of Australian researchers[7] found they would be happy with a funding system that, if run twice in parallel, would see at least 75% of the funded grants funded in both runs.

I strongly suspect (and have modelled) that the current NHMRC system is achieving well below this 75% repeatability target.

Further improvements to the NHMRC system are possible and needed. Assessors could provide comments, as well as scores, to applicants. Better training for assessors would also help. And the biggest interdisciplinary grants should really be assessed by panels.

No funding system will be perfect. And when funding rates are low, those imperfections stand out more. But, at the moment, we are neither making the system as robust as we can nor sufficiently guarding against wayward scoring that goes under the radar.

Read more: 7 things the Australian Research Council review should tackle, from a researcher's point of view[8]

Read more https://theconversation.com/more-money-and-smarter-choices-how-to-fix-australias-broken-nhmrc-medical-research-funding-system-188003

The Times Features

Why Regional Small Businesses in Bendigo Deserve Better Access to Finance in 2025

In the heart of regional Victoria, Bendigo has long stood as a beacon of innovation, resilience and community spirit. As we step further into 2025, the importance of nurturing sm...

Is It Time for a Deep Cleaning? Signs You Shouldn’t Ignore

Most people know they should visit the dentist for a regular check-up and cleaning every six months. But sometimes, a standard cleaning isn’t enough. When plaque and tartar build...

The Hidden Meaning Behind Popular Engagement Ring Cuts

When it comes to engagement rings, the cut of the diamond is not just about aesthetics. Each shape carries its own symbolism and significance, making it an important decision for...

Annual Health Exams in the Office: How They Can Reduce Sick Days and Healthcare Costs

Regular health check-ups, especially annual health exams in the office, can significantly impact the overall well-being of your workforce. A proactive approach to employee health...

Best Deals on Home Furniture Online

Key Highlights Discover the best deals on high-quality outdoor furniture online. Transform your outdoor space into a stylish and comfortable oasis. Explore a wide range of d...

Discover the Best Women's Jumpers for Every Season

Key Highlights Explore lightweight jumpers for spring and summer, ensuring breathability and ease. Wrap up warm with cozy wool jumpers for the chilly autumn and winter season...

Times Magazine

The Essential Guide to Transforming Office Spaces for Maximum Efficiency

Why Office Fitouts MatterA well-designed office can make all the difference in productivity, employee satisfaction, and client impressions. Businesses of all sizes are investing in updated office spaces to create environments that foster collaborat...

The A/B Testing Revolution: How AI Optimized Landing Pages Without Human Input

A/B testing was always integral to the web-based marketing world. Was there a button that converted better? Marketing could pit one against the other and see which option worked better. This was always through human observation, and over time, as d...

Using Countdown Timers in Email: Do They Really Increase Conversions?

In a world that's always on, where marketers are attempting to entice a subscriber and get them to convert on the same screen with one email, the power of urgency is sometimes the essential element needed. One of the most popular ways to create urg...

Types of Software Consultants

In today's technology-driven world, businesses often seek the expertise of software consultants to navigate complex software needs. There are several types of software consultants, including solution architects, project managers, and user experienc...

CWU Assistive Tech Hub is Changing Lives: Win a Free Rollator Walker This Easter!

🌟 Mobility. Independence. Community. All in One. This Easter, the CWU Assistive Tech Hub is pleased to support the Banyule community by giving away a rollator walker. The giveaway will take place during the Macleod Village Easter Egg Hunt & Ma...

"Eternal Nurture" by Cara Barilla: A Timeless Collection of Wisdom and Healing

Renowned Sydney-born author and educator Cara Barilla has released her latest book, Eternal Nurture, a profound collection of inspirational quotes designed to support mindfulness, emotional healing, and personal growth. With a deep commitment to ...

LayBy Shopping