The Times Australia
The Times World News

.

Unis are using artificial intelligence to keep students sitting exams honest. But this creates its own problems

  • Written by Simon Coghlan, Senior Research Fellow in Digital Ethics, Centre for AI and Digital Ethics, School of Computing and Information Systems, The University of Melbourne
Unis are using artificial intelligence to keep students sitting exams honest. But this creates its own problems

Universities are increasingly using computer programs to supervise university students sitting their exams. Is this the future of testing?

Due to the pandemic, institutions worldwide have rapidly adopted exam software[1] like Examplify, ExamSoft and ProctorU.

Proctoring technology allows exam-takers to be monitored off-campus. They can sit exams in their homes, instead of a person having to watch them in a traditional exam room. Some programs simply enable a person to supervise students remotely.

More sophisticated, automated proctoring software hijacks the student’s computer to block and monitor suspicious activity. These programs often use artificial intelligence (AI) to scrutinise exam conduct.

Our recent research paper[2] explored the ethics of automated proctoring. We found the promise of the software alluring, but it carries substantial risks.

Read more: Online exam monitoring is now common in Australian universities — but is it here to stay?[3]

Some educational institutions claim proctoring technologies are needed to prevent cheating. Some other institutions and students are concerned about hidden dangers.

Indeed, students have launched protests[4], petitions[5] and lawsuits[6]. They condemn online proctoring as discriminatory and intrusive, with overtones of Big Brother[7]. Some proctoring companies have responded with attempts to stifle protest, which include suing[8] their critics.

A student’s complaint that test proctoring AI wrongly flagged her as cheating attracted millions of views on TikTok.

What does the software do?

Automated proctoring programs offer tools for examiners to prevent cheating. The programs can capture system information, block web access and analyse keyboard strokes. They can also commandeer computer cameras and microphones to record exam-takers and their surroundings.

Some programs use AI to “flag” suspicious behaviour. Facial recognition algorithms check to make sure the student is still seated and no one else has entered the room. The programs also identify whispering, atypical typing, unusual movements and other behaviours that could suggest cheating.

After the program “flags” an incident, examiners can investigate further by viewing stored video and audio and questioning the student.

Why use proctoring software?

Automated proctoring software purports to reduce cheating in remotely administered exams — a necessity during the pandemic. Fair exams protect the value of qualifications and signal that academic honesty matters. They are a key part of certification requirements for professional fields like medicine and law.

Cheating is unfair to honest students. If left unchecked, it increases incentives for these students to cheat.

The companies selling proctoring software claim their tools prevent cheating and improve exam fairness for everyone — but our work calls that into question.

So what are the problems?

Security

We evaluated the software and found simple technical tricks can bypass many of the anti-cheating protections. This finding suggests the tools may provide only limited benefits.

Requiring students to install software with such powerful control over a computer is a security risk. In some cases the software surreptitiously remains even after students uninstall it.

Access

Some students may lack access to the right devices and the fast internet connections the software requires. This leads to technical issues that cause stress and disadvantage. In one incident[9], 41% of students experienced technical problems.

Privacy

Online proctoring creates privacy issues. Video capture means examiners can see into students’ homes and scrutinise their faces without being noticed. Such intimate monitoring, which is recorded for potential repeat viewings, distinguishes it from traditional in-person exam supervision.

Fairness and bias

Proctoring software raises significant fairness concerns. Facial recognition algorithms in the software we evaluated are not always accurate[10].

A forthcoming paper by one of us found the algorithms used by the major US-based manufacturers do not identify darker-skinned faces[11] as accurately as lighter-skinned faces. The resulting hidden discrimination may add to societal biases. Others have reported similar[12] concerns[13] in proctoring software and in facial recognition technology generally.

Young African American woman looking at laptop with facial recognition mapping superimposed on her face
Proctoring software uses facial recognition technology, which has well-documented problems of ethnic bias. Shutterstock

Read more: Why facial recognition algorithms can't be perfectly fair[14]

Also of concern, the proctoring algorithms may falsely flag atypical eye or head movements in exam-takers. This could lead to unwarranted suspicions about students who are not neuro-typical or who have idiosyncratic exam-sitting styles. Even without automated proctoring, exams are already stressful events that affect our behaviour.

Investigating baseless suspicions

Educational institutions can often choose which automated functions to use or reject. Proctoring companies may insist AI-generated “flags” are not proof of academic dishonesty but only reasons to investigate possible cheating at the institution’s discretion[15].

However, merely investigating and questioning a student can itself be unfair and traumatic when based on spurious machine-generated suspicions.

Surveillance culture

Finally, automated exam monitoring may set a broader precedent. Public concerns about surveillance[16] and automated decision-making[17] are growing. We should be cautious when introducing potentially harmful technologies, especially when these are imposed without our genuine consent.

Read more: Online exam monitoring can invade privacy and erode trust at universities[18]

Where to from here?

It’s important to find ways to fairly administer exams remotely. We will not always be able to replace exams with other assessments.

Nonetheless, institutions using automated proctoring software need to be accountable. This means being transparent with students about how the technology works and what can happen to student data.

Examiners could also offer meaningful alternatives such as in-person exam-sitting options. Offering alternatives is fundamental to informed consent.

While proctoring tools seemingly offer a panacea, institutions must carefully weigh the risks inherent in the technology.

References

  1. ^ software (www.softwaresuggest.com)
  2. ^ research paper (link.springer.com)
  3. ^ Online exam monitoring is now common in Australian universities — but is it here to stay? (theconversation.com)
  4. ^ protests (www.washingtonpost.com)
  5. ^ petitions (www.change.org)
  6. ^ lawsuits (www.docketalarm.com)
  7. ^ Big Brother (www.insidehighered.com)
  8. ^ suing (www.insidehighered.com)
  9. ^ incident (www.reuters.com)
  10. ^ accurate (theconversation.com)
  11. ^ faces (gendershades.org)
  12. ^ similar (www.csmonitor.com)
  13. ^ concerns (www.insidehighered.com)
  14. ^ Why facial recognition algorithms can't be perfectly fair (theconversation.com)
  15. ^ discretion (proctorio.com)
  16. ^ surveillance (www.theguardian.com)
  17. ^ decision-making (www.robodebtclassaction.com.au)
  18. ^ Online exam monitoring can invade privacy and erode trust at universities (theconversation.com)

Read more https://theconversation.com/unis-are-using-artificial-intelligence-to-keep-students-sitting-exams-honest-but-this-creates-its-own-problems-170708

Times Magazine

Building a Strong Online Presence with Katoomba Web Design

Katoomba web design is more than just creating a website that looks good—it’s about building an online presence that reflects your brand, engages your audience, and drives results. For local businesses in the Blue Mountains, a well-designed website a...

September Sunset Polo

International Polo Tour To Bridge Historic Sport, Life-Changing Philanthropy, and Breath-Taking Beauty On Saturday, September 6th, history will be made as the International Polo Tour (IPT), a sports leader headquartered here in South Florida...

5 Ways Microsoft Fabric Simplifies Your Data Analytics Workflow

In today's data-driven world, businesses are constantly seeking ways to streamline their data analytics processes. The sheer volume and complexity of data can be overwhelming, often leading to bottlenecks and inefficiencies. Enter the innovative da...

7 Questions to Ask Before You Sign IT Support Companies in Sydney

Choosing an IT partner can feel like buying an insurance policy you hope you never need. The right choice keeps your team productive, your data safe, and your budget predictable. The wrong choice shows up as slow tickets, surprise bills, and risky sh...

Choosing the Right Legal Aid Lawyer in Sutherland Shire: Key Considerations

Legal aid services play an essential role in ensuring access to justice for all. For people in the Sutherland Shire who may not have the financial means to pay for private legal assistance, legal aid ensures that everyone has access to representa...

Watercolor vs. Oil vs. Digital: Which Medium Fits Your Pet's Personality?

When it comes to immortalizing your pet’s unique personality in art, choosing the right medium is essential. Each artistic medium, whether watercolor, oil, or digital, has distinct qualities that can bring out the spirit of your furry friend in dif...

The Times Features

NSW has a new fashion sector strategy – but a sustainable industry needs a federally legislated response

The New South Wales government recently announced the launch of the NSW Fashion Sector Strategy, 2025–28[1]. The strategy, developed in partnership with the Australian Fashion ...

From Garden to Gift: Why Roses Make the Perfect Present

Think back to the last time you gave or received flowers. Chances are, roses were part of the bunch, or maybe they were the whole bunch.   Roses tend to leave an impression. Even ...

Do I have insomnia? 5 reasons why you might not

Even a single night of sleep trouble can feel distressing and lonely. You toss and turn, stare at the ceiling, and wonder how you’ll cope tomorrow. No wonder many people star...

Wedding Photography Trends You Need to Know (Before You Regret Your Album)

Your wedding album should be a timeless keepsake, not something you cringe at years later. Trends may come and go, but choosing the right wedding photography approach ensures your ...

Can you say no to your doctor using an AI scribe?

Doctors’ offices were once private. But increasingly, artificial intelligence (AI) scribes (also known as digital scribes) are listening in. These tools can record and trans...

There’s a new vaccine for pneumococcal disease in Australia. Here’s what to know

The Australian government announced last week there’s a new vaccine[1] for pneumococcal disease on the National Immunisation Program for all children. This vaccine replaces pr...