Google AI
The Times Australia

Times Media

AI in the classroom is hard to detect – time to bring back oral tests

  • Written by: Shahper Richter, Senior Lecturer in Digital Marketing, University of Auckland, Waipapa Taumata Rau

News that several New Zealand universities have given up using detection software[1] to expose student use of artificial intelligence (AI) underlines the challenge higher education is facing.

With AI tools such as ChatGPT now able to produce essays, reports and case studies in seconds, the old assessment model is breaking down. For decades, that model was valued for testing not just knowledge, but also analysis, argumentation and communication.

Now, however, its reliability is under pressure. If a machine can generate a plausible essay on demand, how can we be sure we are assessing a student’s own understanding and reasoning?

We have been exploring another way forward. Instead of doubling down on plagiarism software, we have gone back to something surprisingly simple: talking to students.

For the past two years, we have been running “interactive oral assessments[2]” (IOAs). They are proving to be one of the most effective and authentic ways to see what students really know in the age of AI.

Think of it as a structured conversation. Students meet with a lecturer or tutor, individually or in a small group, and answer questions about work they have already submitted.

Examiners do not just check for memorised facts. Using the Socratic method of questioning[3], they probe the reasoning behind students’ answers, drawing out genuine understanding rather than rehearsed responses.

It is not a performance or a speech. Because the questions are tailored to each student and unfold in real time, IOAs are difficult to outsource: a chatbot may produce text, but it cannot sustain a probing conversation about your own work.

Face-to-face assessment

We first trialled IOAs[4] in a postgraduate marketing course with 42 students. Each sat a seven-minute conversation based on their course work. The grading guide covered both content (do they understand the concepts?) and communication (can they explain clearly and logically?).

The results were encouraging. Where grades had previously skewed toward the upper range under written assessment, likely reflecting increased AI assistance on take-home assignments, IOAs produced a more balanced spread of marks across grade bands.

Students reported the process felt fairer, and lecturers heard richer demonstrations of understanding and critical thinking. One lecturer put it neatly:

The dialogue revealed what students actually understood, rather than what they could memorise or outsource.

To ensure nerves did not get in the way, we built practice runs into tutorials during the semester so expectations were clear long before the final assessment.

Running one-on-one conversations for hundreds of students isn’t realistic, so we adapted the format. In larger undergraduate courses with over 200 students, we run IOAs in group settings: students attend together, but each answers individually.

We also use multiple assessors running simultaneous IOA sessions. This lets us assess large cohorts in the same timeframe as a traditional exam without overloading a single lecturer or tutor.

This model has two big advantages: logistics are manageable and anxiety is reduced. Seeing peers go through the same process normalises the experience. The group format still preserves the essence of the IOA.

Back to the future?

Two years in, clear patterns have emerged. IOAs reveal qualities written exams and essays often mask. Students must explain, apply and defend their ideas in real time, so we can see whether they truly grasp the material, not just whether they can structure an essay or reproduce text.

Importantly, IOAs also develop work-ready skills: clear communication, critical thinking and defending a position under questioning. These abilities are needed in interviews, client meetings and professional discussions. As one student said:

It felt like a job interview, not just an exam.

IOAs are not effort-free. Examiners benefit from training in how to ask probing yet fair questions, and in applying grading guides consistently, especially when student and session numbers increase.

Scheduling and recording at scale requires careful planning, from coordinating rooms to examiner availability and recording options. With the right support, however, these challenges are manageable.

IOAs are not a silver bullet, but they are a promising response to the realities of AI. They make it harder to outsource work, help staff see genuine understanding, and give students practice in the kinds of discussions that dominate modern workplaces.

In many ways, IOAs take us back to the future: they revive the oldest oral form of examination, reimagined for today’s classrooms. Crucially, they do more than safeguard academic integrity, they build the capabilities employers expect.

If universities want to prepare students for the real world while protecting the credibility of their courses, it may be time to do what seems counterintuitive: stop writing and start talking.

References

  1. ^ given up using detection software (www.rnz.co.nz)
  2. ^ interactive oral assessments (teachwell.auckland.ac.nz)
  3. ^ Socratic method of questioning (www.law.uchicago.edu)
  4. ^ first trialled IOAs (www.youtube.com)

Read more https://theconversation.com/ai-in-the-classroom-is-hard-to-detect-time-to-bring-back-oral-tests-265955

Australia

NATIONAL ALARM: Why Every Australian Phone Will Blare An Un-Silencable Siren Today

At exactly 2:00 pm AEST today, millions of mobile phones, smartwatches, and tablets across Australia will simult...

One Nation at 29: Protest Party or Permanent Political Force?

Twenty-nine years ago, when Pauline Hanson's One Nation was officially formed in 1997, many political observers ...

Oil prices surge as conflict resumes: What does it mean for Australia's fuel supply?

Global oil prices have jumped sharply after renewed fighting in the Middle East reignited fears of supply disrup...

Times Magazine

Looking Beyond EVs? Australia's Most Fuel-Efficient Petrol Cars Still Make a Strong Case

Electric vehicles continue to dominate headlines, but they are not the right choice for every Aust...

iPhone Health Apps: Helpful Health Coach or Digital Obsession?

Millions of Australians carry a sophisticated health monitor in their pocket without giving it muc...

The new ‘Apple Upgrade’ program has officially launched in the United States

TECH GIANT SHAKES UP FINANCING WITH KLARNA-BACKED SUBSCRIPTION LEASE CUPERTINO — Apple has offici...

Technology

iPhone Health Apps: Helpful Health …

Millions of Australians carry a sophisticated health monitor in their pocket without giving it muc...

Local News

Psychology clinic in Tasmania opens…

In response to Tasmania’s growing mental health crisis, a new purpose-built, multi-disciplinary me...

Culture

iPhone Health Apps: Helpful Health Coach or D…

Millions of Australians carry a sophisticated health monitor in their pocket without giving it muc...

Travel

Korea Tourism Organization Invites Australian…

The Korea Tourism Organization (KTO) has launched Korea Unlocks More of You, a new national campai...

The Times Features

Mr Roses expands beyond flowers with launch of national…

Australian premium gifting business Mr Roses has expanded beyond flowers with the launch of Mr Ros...

Psychology clinic in Tasmania opens to address growing …

In response to Tasmania’s growing mental health crisis, a new purpose-built, multi-disciplinary me...

Sweet Temptation: Should Australia Take a Harder Look a…

Walk through almost any Australian supermarket and one of the brightest, most colourful sections i...