Google AI
The Times Australia

Times Media

AI in the classroom is hard to detect – time to bring back oral tests

  • Written by: Shahper Richter, Senior Lecturer in Digital Marketing, University of Auckland, Waipapa Taumata Rau

News that several New Zealand universities have given up using detection software[1] to expose student use of artificial intelligence (AI) underlines the challenge higher education is facing.

With AI tools such as ChatGPT now able to produce essays, reports and case studies in seconds, the old assessment model is breaking down. For decades, that model was valued for testing not just knowledge, but also analysis, argumentation and communication.

Now, however, its reliability is under pressure. If a machine can generate a plausible essay on demand, how can we be sure we are assessing a student’s own understanding and reasoning?

We have been exploring another way forward. Instead of doubling down on plagiarism software, we have gone back to something surprisingly simple: talking to students.

For the past two years, we have been running “interactive oral assessments[2]” (IOAs). They are proving to be one of the most effective and authentic ways to see what students really know in the age of AI.

Think of it as a structured conversation. Students meet with a lecturer or tutor, individually or in a small group, and answer questions about work they have already submitted.

Examiners do not just check for memorised facts. Using the Socratic method of questioning[3], they probe the reasoning behind students’ answers, drawing out genuine understanding rather than rehearsed responses.

It is not a performance or a speech. Because the questions are tailored to each student and unfold in real time, IOAs are difficult to outsource: a chatbot may produce text, but it cannot sustain a probing conversation about your own work.

Face-to-face assessment

We first trialled IOAs[4] in a postgraduate marketing course with 42 students. Each sat a seven-minute conversation based on their course work. The grading guide covered both content (do they understand the concepts?) and communication (can they explain clearly and logically?).

The results were encouraging. Where grades had previously skewed toward the upper range under written assessment, likely reflecting increased AI assistance on take-home assignments, IOAs produced a more balanced spread of marks across grade bands.

Students reported the process felt fairer, and lecturers heard richer demonstrations of understanding and critical thinking. One lecturer put it neatly:

The dialogue revealed what students actually understood, rather than what they could memorise or outsource.

To ensure nerves did not get in the way, we built practice runs into tutorials during the semester so expectations were clear long before the final assessment.

Running one-on-one conversations for hundreds of students isn’t realistic, so we adapted the format. In larger undergraduate courses with over 200 students, we run IOAs in group settings: students attend together, but each answers individually.

We also use multiple assessors running simultaneous IOA sessions. This lets us assess large cohorts in the same timeframe as a traditional exam without overloading a single lecturer or tutor.

This model has two big advantages: logistics are manageable and anxiety is reduced. Seeing peers go through the same process normalises the experience. The group format still preserves the essence of the IOA.

Back to the future?

Two years in, clear patterns have emerged. IOAs reveal qualities written exams and essays often mask. Students must explain, apply and defend their ideas in real time, so we can see whether they truly grasp the material, not just whether they can structure an essay or reproduce text.

Importantly, IOAs also develop work-ready skills: clear communication, critical thinking and defending a position under questioning. These abilities are needed in interviews, client meetings and professional discussions. As one student said:

It felt like a job interview, not just an exam.

IOAs are not effort-free. Examiners benefit from training in how to ask probing yet fair questions, and in applying grading guides consistently, especially when student and session numbers increase.

Scheduling and recording at scale requires careful planning, from coordinating rooms to examiner availability and recording options. With the right support, however, these challenges are manageable.

IOAs are not a silver bullet, but they are a promising response to the realities of AI. They make it harder to outsource work, help staff see genuine understanding, and give students practice in the kinds of discussions that dominate modern workplaces.

In many ways, IOAs take us back to the future: they revive the oldest oral form of examination, reimagined for today’s classrooms. Crucially, they do more than safeguard academic integrity, they build the capabilities employers expect.

If universities want to prepare students for the real world while protecting the credibility of their courses, it may be time to do what seems counterintuitive: stop writing and start talking.

References

  1. ^ given up using detection software (www.rnz.co.nz)
  2. ^ interactive oral assessments (teachwell.auckland.ac.nz)
  3. ^ Socratic method of questioning (www.law.uchicago.edu)
  4. ^ first trialled IOAs (www.youtube.com)

Read more https://theconversation.com/ai-in-the-classroom-is-hard-to-detect-time-to-bring-back-oral-tests-265955

Australia

Two Years and Six Months On: How Has the Second Trump Presidency Fared for Australia?

With the second Trump presidency now at its halfway point, Australians are in a better position to judge its imp...

Cost of Living: Tax Cuts, Higher Wages and Fuel Relief Arrive — But Will Australians Feel Better Off?

Cost of Living: July Brings Tax Cuts, Higher Wages and Fuel Relief — But Will Australians Feel Richer? For many...

Australian Universities: Educating Australians or Building an Export Industry?

For generations, Australian universities existed for a straightforward purpose: to educate Australians. They tr...

Times Magazine

Will Travis Kelce follow the athlete silicone ring trend?

From the NFL to the All Blacks, professional athletes have been ditching metal for silicone rings. W...

The AI economy: How artificial intelligence is creating the jobs of tomorrow in Australia

Artificial intelligence has become one of the most discussed technologies of the decade, often acc...

Yoga and Tai Chi: Why Simple Movement Still Inspires Millions

In a world of high-intensity workouts, fitness technology and ever-changing exercise trends, two a...

Technology

Why Australian Enterprises Are Reth…

The corporate landscape in Australia has undergone a permanent structural shift over the past few ...

Local News

QLD Day

On Saturday 6 June, parkrun events across the state will be a sea of maroon, with communities  str...

Culture

Measles in Australia: Why This Highly Contagi…

Measles was once considered a childhood illness that had largely disappeared from Australia. Thank...

Travel

Byron Bay with Friends: Forget the Camping Ge…

There is something special about packing the car on a Friday afternoon and heading away with frien...

The Times Features

Vacuum cleaners: from the Hoover to the robot revolutio…

For much of the past century, the vacuum cleaner was one of the least-changed appliances in the ho...

When you sell your life's work: how capital gains …

For many Australians, an investment property is the most familiar example of a capital gains tax e...

Where do cautious Australians invest? A guide to the ma…

For generations, Australians have been encouraged to invest for the future. The challenge is that ...