The Times Australia
The Times World News

.

Australia has its first framework for AI use in schools – but we need to proceed with caution

  • Written by Lucinda McKnight, Senior Lecturer in Pedagogy and Curriculum, Deakin University
Australia has its first framework for AI use in schools – but we need to proceed with caution

Federal and state governments have just released a national framework[1] for generative AI in schools. This paves the way for generative AI[2] – algorithms that can create new content – to be used routinely in classrooms around the country.

This provides much-needed guidance, a full year after the launch of ChatGPT. Over the past 12 months, schools have had a range of responses[3] to the technology from outright banning to trying to incorporate it into learning.

What is in the framework and what is missing?

Read more: High school students are using a ChatGPT-style app in an Australia-first trial[4]

What is the framework?

The framework was agreed by state and federal education ministers in October and released publicly last week.

It is designed to help schools use generative AI “in a safe and effective way”. It notes it has “great potential to assist teaching and learning and reduce administrative workload in Australian schools”. But at the same time it warns of risk and consequences, including

the potential for errors and algorithmic bias in generative AI content; the misuse of personal or confidential information; and the use of generative AI for inappropriate purposes, such as to discriminate against individuals or groups, or to undermine the integrity of student assessments.

Federal Education Minister Jason Clare also stressed “schools should not use generative AI products that sell student data”.

What is in the framework?

The framework itself is just two pages long, and includes six overarching principles and 25 “guiding statements”. The six principles are:

  • teaching and learning, including schools teaching students about how these tools work, including their potential limitations and biases

  • human and social wellbeing, including using tools in a way that avoids reinforcing biases

  • transparency, including disclosing when tools are used and their impact

  • fairness, including access for people from diverse and disadvantaged backgrounds

  • accountability, including schools testing tools before they use them, and

  • privacy, security and safety, including the use of “robust” cyber-security measures.

The framework will be reviewed every 12 months.

Read more: AI is now accessible to everyone: 3 things parents should teach their kids[5]

Caution is needed

The framework does important work acknowledging opportunities of this technology, while noting the importance of wellbeing, privacy, security and safety.

However, some of these concepts are much less straightforward than the framework suggests. As experts in generative AI in education, we have moved from optimism to a much more cautious stance about this technology over the past 12 months. As UNESCO has recently warned[6],

the speed at which generative AI technologies are being integrated into education systems in the absence of checks, rules or regulations, is astonishing.

The framework puts an extraordinary onus on schools and teachers to do high-stakes work for which they may not be qualified or do not have time or funding to complete.

For example, the framework calls for “explainability” – but even the developers of AI models struggle to fully explain[7] how they work.

The framework also calls on schools to do risk assessments of algorithms[8], design appropriate learning experiences, revise assessments, consult with communities, learn about and apply intellectual property rights and copyright law and generally become expert in the use of generative AI.

It is not clear how this can possibly be achieved within existing workloads, which we know are already stretched[9]. This is particularly so when the nature[10] and ethics of generative AI are complex and contested[11]. We also know the technology is not foolproof – it makes mistakes[12].

Here are five areas we think need to be included in any further version of this framework.

1. A more honest stance on generative AI

We need to be clear that generative AI is biased. This is because it reflects the biases of its training materials[13], including what is published on the internet.

Such limited datasets are created largely by those who are white, male and United States or Western-based[14].

For example, a current version of ChatGPT does not speak in or use Australian First Nations words. There may be valid reasons for this, such as not using cultural knowledges without permission. But this indicates the whiteness of its “voice” and the problems inherent in requiring students to use or rely on it.

2. More evidence

The use of technology does not automatically improve teaching and learning.

So far, there is little research demonstrating the benefits of generative AI use in education. In fact, (a recent UNESCO report[15] confirmed there is little evidence of any improvement to learning from the use of digital technology in classrooms over decades.

But we do have research showing the the harms of algorithms. For example, AI-driven feedback[16] narrows the kinds of writing students produce and privileges white voices.

Schools need support to develop processes and procedures to monitor and evaluate the use of generative AI by both staff and students.

3. Acknowledging dangers around bots

There is long-standing research[17] demonstrating the dangers of chatbots and their capacity to harm human creativity and critical thinking. This happens because humans seem to automatically trust bots and their outputs.

The framework should aim to clarify which (low-stakes) tasks are and are not suitable for generative AI for both students and teachers. High stakes marking, for example, should be completed by humans.

4. Transparency

So far, the framework seems to focus on students and their activities,

All use of generative AI in schools needs to be disclosed. This should include teachers using generative AI to prepare teaching materials and plan lessons.

5. Acknowledging teachers’ expertise

The global education technology (“edtech”) market was estimated to be worth about US$300 billion[18] (A$450 billion) as of 2022. Some companies argue[19] edtech can be used to monitor students’ progress and take over roles traditionally done by teachers.

Australia’s national education policies need to ensure teachers’ roles are not downgraded as AI use becomes more common. Teachers are experts in more than just subject matter. They are experts in how to teach various disciplines and in their students’ and communities’ needs.

Read more: The rise of ChatGPT shows why we need a clearer approach to technology in schools[20]

References

  1. ^ national framework (www.education.gov.au)
  2. ^ generative AI (www.mckinsey.com)
  3. ^ range of responses (theconversation.com)
  4. ^ High school students are using a ChatGPT-style app in an Australia-first trial (theconversation.com)
  5. ^ AI is now accessible to everyone: 3 things parents should teach their kids (theconversation.com)
  6. ^ recently warned (unesdoc.unesco.org)
  7. ^ fully explain (www.nature.com)
  8. ^ risk assessments of algorithms (www.businessofgovernment.org)
  9. ^ already stretched (www.abc.net.au)
  10. ^ nature (bera-journals.onlinelibrary.wiley.com)
  11. ^ contested (cmci.colorado.edu)
  12. ^ makes mistakes (www.ibm.com)
  13. ^ biases of its training materials (dl.acm.org)
  14. ^ white, male and United States or Western-based (www.bloomberg.com)
  15. ^ a recent UNESCO report (www.unesco.org)
  16. ^ AI-driven feedback (www.tandfonline.com)
  17. ^ long-standing research (dl.acm.org)
  18. ^ US$300 billion (www.holoniq.com)
  19. ^ argue (www.theaustralian.com.au)
  20. ^ The rise of ChatGPT shows why we need a clearer approach to technology in schools (theconversation.com)

Read more https://theconversation.com/australia-has-its-first-framework-for-ai-use-in-schools-but-we-need-to-proceed-with-caution-219094

Times Magazine

Building a Strong Online Presence with Katoomba Web Design

Katoomba web design is more than just creating a website that looks good—it’s about building an online presence that reflects your brand, engages your audience, and drives results. For local businesses in the Blue Mountains, a well-designed website a...

September Sunset Polo

International Polo Tour To Bridge Historic Sport, Life-Changing Philanthropy, and Breath-Taking Beauty On Saturday, September 6th, history will be made as the International Polo Tour (IPT), a sports leader headquartered here in South Florida...

5 Ways Microsoft Fabric Simplifies Your Data Analytics Workflow

In today's data-driven world, businesses are constantly seeking ways to streamline their data analytics processes. The sheer volume and complexity of data can be overwhelming, often leading to bottlenecks and inefficiencies. Enter the innovative da...

7 Questions to Ask Before You Sign IT Support Companies in Sydney

Choosing an IT partner can feel like buying an insurance policy you hope you never need. The right choice keeps your team productive, your data safe, and your budget predictable. The wrong choice shows up as slow tickets, surprise bills, and risky sh...

Choosing the Right Legal Aid Lawyer in Sutherland Shire: Key Considerations

Legal aid services play an essential role in ensuring access to justice for all. For people in the Sutherland Shire who may not have the financial means to pay for private legal assistance, legal aid ensures that everyone has access to representa...

Watercolor vs. Oil vs. Digital: Which Medium Fits Your Pet's Personality?

When it comes to immortalizing your pet’s unique personality in art, choosing the right medium is essential. Each artistic medium, whether watercolor, oil, or digital, has distinct qualities that can bring out the spirit of your furry friend in dif...

The Times Features

NSW has a new fashion sector strategy – but a sustainable industry needs a federally legislated response

The New South Wales government recently announced the launch of the NSW Fashion Sector Strategy, 2025–28[1]. The strategy, developed in partnership with the Australian Fashion ...

From Garden to Gift: Why Roses Make the Perfect Present

Think back to the last time you gave or received flowers. Chances are, roses were part of the bunch, or maybe they were the whole bunch.   Roses tend to leave an impression. Even ...

Do I have insomnia? 5 reasons why you might not

Even a single night of sleep trouble can feel distressing and lonely. You toss and turn, stare at the ceiling, and wonder how you’ll cope tomorrow. No wonder many people star...

Wedding Photography Trends You Need to Know (Before You Regret Your Album)

Your wedding album should be a timeless keepsake, not something you cringe at years later. Trends may come and go, but choosing the right wedding photography approach ensures your ...

Can you say no to your doctor using an AI scribe?

Doctors’ offices were once private. But increasingly, artificial intelligence (AI) scribes (also known as digital scribes) are listening in. These tools can record and trans...

There’s a new vaccine for pneumococcal disease in Australia. Here’s what to know

The Australian government announced last week there’s a new vaccine[1] for pneumococcal disease on the National Immunisation Program for all children. This vaccine replaces pr...