The Times Australia
The Times World News

.

Will AI decide if you get your next job? Without legal regulation, you may never even know

  • Written by Natalie Sheard, Lawyer and PhD Candidate, La Trobe University
Will AI decide if you get your next job? Without legal regulation, you may never even know

The use of artificial intelligence (AI) and other automated decision-making tools in recruitment is on the rise among Australian organisations. However, research shows these tools may be unreliable and discriminatory, and in some cases rely on discredited science.

At present, Australia has no specific laws to regulate how these tools operate or how organisations may use them.

The closest thing we have is new guidance[1] for employers in the public sector, issued by the Merit Protection Commissioner after overturning several automated promotion decisions.

A first step

The commissioner reviews promotion decisions[2] in the Australian public sector to make sure they are lawful, fair and reasonable. In the 2021-22 financial year, Commissioner Linda Waugh overturned 11 promotion decisions[3] made by government agency Services Australia in a single recruitment round.

These decisions were made using a new automated process that required applicants to pass through a sequence of AI assessments, including psychometric testing, questionnaires and self-recorded video responses. The commissioner found this process, which involved no human decision-making or review, led to meritorious applicants missing out on promotions.

Read more: Algorithms can decide your marks, your work prospects and your financial security. How do you know they're fair?[4]

The commissioner has now issued guidance material[5] for Australian government departments on how to choose and use AI recruitment tools.

This is the first official guidance given to employers in Australia. It warns that not all AI recruitment tools on the market here have been thoroughly tested, nor are they guaranteed to be completely unbiased.

AI recruitment tools risky and unregulated

AI tools are used to automate or assist recruiters with sourcing, screening and onboarding job applicants. By one estimate[6], more than 250 commercial AI recruitment tools are available in Australia, including CV screening and video assessment.

A recent survey[7] by researchers at Monash University and the Diversity Council of Australia found one in three Australian organisations have used AI in recruitment recently.

The use of AI recruitment tools is a “high risk[8]” activity. By affecting decisions related to employment, these tools may impact the human rights of job seekers and risk locking disadvantaged groups out of employment opportunities.

Australia has no specific legislation regulating the use of these tools. Australia’s Department of Industry has published AI Ethics Principles[9], but these are not legally binding. Existing laws, such as the Privacy Act and anti-discrimination legislation, are in urgent need of reform.

Unreliable and discriminatory?

AI recruitment tools involve new and developing technologies. They may be unreliable[10] and there are well-publicised examples[11] of discrimination against historically disadvantaged groups.

AI recruitment tools may discriminate against these groups[12] when their members are missing from the datasets on which AI is trained, or when discriminatory structures, practices or attitudes are transmitted to these tools in their development or deployment.

There is currently no standard test that identifies when an AI recruitment tool is discriminatory. Further, as these tools are often made outside Australia, they are not attuned to Australian law or demographics. For example, it is very likely training datasets do not include Australia’s First Nations peoples.

Lack of safeguards

AI recruitment tools used by and on behalf of employers in Australia lack adequate safeguards.

Human rights risk and impact assessments are not required prior to deployment. Monitoring and evaluation once they are in use may not occur. Job seekers lack meaningful opportunities to provide input on their use.

While the vendors of these tools may conduct internal testing and auditing, the results are often not publicly available. Independent external auditing is rare.

Power imbalance

Job seekers are at a considerable disadvantage when employers use these tools. They may be invisible and inscrutable, and they are changing hiring practices in ways that are not well understood.

Job seekers have no legal right to be told[13] when AI is used to assess them in the hiring process. Nor are they required to be given an explanation of how an AI recruitment tool will assess them.

Read more: Artificial intelligence can deepen social inequality. Here are 5 ways to help prevent this[14]

My research has found this is particularly problematic for job seekers with disabilities. For example, job seekers with low vision or limited manual dexterity may not know they will be assessed on the speed of their responses until it is too late.

Job seekers in Australia also lack the protection available to their counterparts in the European Union, who have the right not to be subjected to a fully automated recruitment decision[15].

Facial analysis

The use of video assessment tools, like those used by Services Australia, is particularly concerning. Many of these AI tools rely on facial analysis, which uses facial features and movements to infer behavioural, emotional and character traits.

This type of analysis has been scientifically discredited[16]. One prominent vendor, HireVue, was forced to cease the use of facial analysis in its AI tool as a result of a formal complaint in the United States[17].

What’s next?

The Services Australia example highlights the urgent need for a regulatory response. The Australian government is currently consulting on the regulation of AI and automated decision-making[18].

We can hope that new regulations will address the many issues with the use of AI tools in recruitment. Until legal protections are in place, it might be best to hold off on the use of these tools to screen job seekers.

References

  1. ^ new guidance (www.mpc.gov.au)
  2. ^ reviews promotion decisions (www.mpc.gov.au)
  3. ^ overturned 11 promotion decisions (www.transparency.gov.au)
  4. ^ Algorithms can decide your marks, your work prospects and your financial security. How do you know they're fair? (theconversation.com)
  5. ^ guidance material (theconversation.com)
  6. ^ one estimate (www.dca.org.au)
  7. ^ recent survey (www.dca.org.au)
  8. ^ high risk (artificialintelligenceact.eu)
  9. ^ AI Ethics Principles (www.industry.gov.au)
  10. ^ may be unreliable (www.youtube.com)
  11. ^ well-publicised examples (www.reuters.com)
  12. ^ discriminate against these groups (papers.ssrn.com)
  13. ^ no legal right to be told (search.informit.org)
  14. ^ Artificial intelligence can deepen social inequality. Here are 5 ways to help prevent this (theconversation.com)
  15. ^ the right not to be subjected to a fully automated recruitment decision (gdpr-info.eu)
  16. ^ scientifically discredited (journals.sagepub.com)
  17. ^ formal complaint in the United States (www.wired.com)
  18. ^ regulation of AI and automated decision-making (consult.industry.gov.au)

Read more https://theconversation.com/will-ai-decide-if-you-get-your-next-job-without-legal-regulation-you-may-never-even-know-196282

Times Magazine

Headless CMS in Digital Twins and 3D Product Experiences

Image by freepik As the metaverse becomes more advanced and accessible, it's clear that multiple sectors will use digital twins and 3D product experiences to visualize, connect, and streamline efforts better. A digital twin is a virtual replica of ...

The Decline of Hyper-Casual: How Mid-Core Mobile Games Took Over in 2025

In recent years, the mobile gaming landscape has undergone a significant transformation, with mid-core mobile games emerging as the dominant force in app stores by 2025. This shift is underpinned by changing user habits and evolving monetization tr...

Understanding ITIL 4 and PRINCE2 Project Management Synergy

Key Highlights ITIL 4 focuses on IT service management, emphasising continual improvement and value creation through modern digital transformation approaches. PRINCE2 project management supports systematic planning and execution of projects wit...

What AI Adoption Means for the Future of Workplace Risk Management

Image by freepik As industrial operations become more complex and fast-paced, the risks faced by workers and employers alike continue to grow. Traditional safety models—reliant on manual oversight, reactive investigations, and standardised checklist...

From Beach Bops to Alpine Anthems: Your Sonos Survival Guide for a Long Weekend Escape

Alright, fellow adventurers and relaxation enthusiasts! So, you've packed your bags, charged your devices, and mentally prepared for that glorious King's Birthday long weekend. But hold on, are you really ready? Because a true long weekend warrior kn...

Effective Commercial Pest Control Solutions for a Safer Workplace

Keeping a workplace clean, safe, and free from pests is essential for maintaining productivity, protecting employee health, and upholding a company's reputation. Pests pose health risks, can cause structural damage, and can lead to serious legal an...

The Times Features

Tricia Paoluccio designer to the stars

The Case for Nuturing Creativity in the Classroom, and in our Lives I am an actress and an artist who has had the privilege of sharing my work across many countries, touring my ...

Duke of Dural to Get Rooftop Bar as New Owners Invest in Venue Upgrade

The Duke of Dural, in Sydney’s north-west, is set for a major uplift under new ownership, following its acquisition by hospitality group Good Beer Company this week. Led by resp...

Prefab’s Second Life: Why Australia’s Backyard Boom Needs a Circular Makeover

The humble granny flat is being reimagined not just as a fix for housing shortages, but as a cornerstone of circular, factory-built architecture. But are our systems ready to s...

Melbourne’s Burglary Boom: Break-Ins Surge Nearly 25%

Victorian homeowners are being warned to act now, as rising break-ins and falling arrest rates paint a worrying picture for suburban safety. Melbourne residents are facing an ...

Exploring the Curriculum at a Modern Junior School in Melbourne

Key Highlights The curriculum at junior schools emphasises whole-person development, catering to children’s physical, emotional, and intellectual needs. It ensures early year...

Distressed by all the bad news? Here’s how to stay informed but still look after yourself

If you’re feeling like the news is particularly bad at the moment, you’re not alone. But many of us can’t look away – and don’t want to. Engaging with news can help us make ...