The Times Australia
The Times Australia

.
The Times Real Estate

.

Google is rolling out its Gemini AI chatbot to kids under 13. It’s a risky move

  • Written by Lisa M. Given, Professor of Information Sciences & Director, Social Change Enabling Impact Platform, RMIT University

Google has announced it will roll out its Gemini artificial intelligence (AI) chatbot[1] to children under the age of 13.

While the launch starts within the next week in the United States and Canada, it will launch in Australia[2] later this year. The chatbot will only be available to people via Google’s Family Link accounts[3].

But this development comes with major risks. It also highlights how, even if children are banned from social media, parents will still have to play a game of whack-a-mole with new technologies as they try to keep their children safe.

A good way to address this would be to urgently implement a digital duty of care for big tech companies such as Google.

How will the Gemini AI chatbot work?

Google’s Family Link accounts[4] allow parents to control access to content and apps, such as YouTube.

To create a child’s account, parents provide personal details[5], including the child’s name and date of birth. This may raise privacy concerns for parents concerned about data breaches, but Google says children’s data when using the system will not be used to train the AI system[6].

Chatbot access will be “on” by default, so parents need to actively turn the feature off to restrict access. Young children will be able to prompt the chatbot for text responses, or to create images, which are generated by the system.

Google acknowledges[7] the system may “make mistakes”. So assessment of the quality and trustworthiness of content is needed. Chatbots can make up information (known as “hallucinating[8]”), so if children use the chatbot for homework help, they need to check facts with reliable sources.

What kinds of information will the system provide?

Google and other search engines retrieve original materials for people to review. A student can read news articles, magazines and other sources when writing up an assignment.

Generative AI tools are not the same as search engines. AI tools look for patterns in source material and create new text responses (or images) based on the query – or “prompt” – a person provides. A child could ask the system to “draw a cat” and the system will scan for patterns in the data of what a cat looks like (such as whiskers, pointy ears, and a long tail) and generate an image that includes those cat-like details.

Understanding the differences between materials retrieved in a Google search and content generated by an AI tool will be challenging for young children. Studies show even adults can be deceived by AI tools[9]. And even highly skilled professionals – such as lawyers[10] – have reportedly been fooled into using fake content generated by ChatGPT and other chatbots.

Will the content generated be age-appropriate?

Google says the system will include “built-in safeguards designed to prevent the generation of inappropriate or unsafe content[11]”.

However, these safeguards could create new problems. For example, if particular words (such as “breasts”) are restricted to protect children from accessing inappropriate sexual content, this could mistakenly also exclude children from accessing age-appropriate content about bodily changes during puberty.

Many children are also very tech-savvy[12], often with well-developed skills for navigating apps and getting around system controls. Parents cannot rely exclusively on inbuilt safeguards. They need to review generated content and help their children understand how the system works, and assess whether content is accurate.

Close up photo of Google logo sign.
Google says there will be safeguards to minimise the risk of harm for children using Gemini, but these could create new problems. Dragos Asaeftei/Shutterstock[13]

What risks do AI chatbots pose to children?

The eSafety Commission[14] has issued an online safety advisory on the potential risk of AI chatbots, including those designed to simulate personal relationships, particularly for young children.

The eSafety advisory explains AI companions can “share harmful content, distort reality and give advice that is dangerous”. The advisory highlights the risks for young children, in particular, who “are still developing the critical thinking and life skills needed to understand how they can be misguided or manipulated by computer programs, and what to do about it”.

My research team has recently examined a range of AI chatbots, such as ChatGPT, Replika, and Tessa[15]. We found these systems mirror people’s interactions based on the many unwritten rules that govern social behaviour – or, what are known as “feeling rules”. These rules are what lead us to say “thank you” when someone holds the door open for us, or “I’m sorry!” when you bump into someone on the street.

By mimicking these and other social niceties, these systems are designed to gain our trust.

These human-like interactions will be confusing, and potentially risky, for young children. They may believe content can be trusted, even when the chatbot is responding with fake information. And, they may believe they are engaging with a real person, rather than a machine.

A mother teaching her child the alphabet.
AI chatbots such as Gemini are designed to mimic human behaviour and gain our trust. Ground Picture[16]

How can we protect kids from harm when using AI chatbots?

This rollout is happening at a crucial time in Australia, as children under 16 will be banned[17] from holding social media accounts in December this year.

While some parents may believe this will keep their children safe from harm, generative AI chatbots show the risks of online engagement extend far beyond social media. Children – and parents – must be educated in how all types of digital tools can be used appropriately and safely.

As Gemini’s AI chatbot is not a social media tool, it will fall outside Australia’s ban.

This leaves Australian parents playing a game of whack-a-mole with new technologies as they try to keep their children safe. Parents must keep up with new tool developments and understand the potential risks their children face. They must also understand the limitations of the social media ban in protecting children from harm.

This highlights the urgent need to revisit Australia’s proposed digital duty of care[18] legislation. While the European Union and United Kingdom launched digital duty of care legislation in 2023, Australia’s has been on hold since November 2024. This legislation would hold technology companies to account by legislating that they deal with harmful content, at source, to protect everyone.

References

  1. ^ Gemini artificial intelligence (AI) chatbot (www.nytimes.com)
  2. ^ launch in Australia (www.abc.net.au)
  3. ^ Family Link accounts (families.google)
  4. ^ Family Link accounts (families.google)
  5. ^ parents provide personal details (www.techbusinessnews.com.au)
  6. ^ will not be used to train the AI system (www.theverge.com)
  7. ^ Google acknowledges (support.google.com)
  8. ^ hallucinating (theconversation.com)
  9. ^ deceived by AI tools (www.sciencedirect.com)
  10. ^ such as lawyers (www.abc.net.au)
  11. ^ built-in safeguards designed to prevent the generation of inappropriate or unsafe content (www.techbusinessnews.com.au)
  12. ^ tech-savvy (www.theguardian.com)
  13. ^ Dragos Asaeftei/Shutterstock (www.shutterstock.com)
  14. ^ eSafety Commission (www.esafety.gov.au)
  15. ^ AI chatbots, such as ChatGPT, Replika, and Tessa (osf.io)
  16. ^ Ground Picture (www.shutterstock.com)
  17. ^ children under 16 will be banned (theconversation.com)
  18. ^ digital duty of care (theconversation.com)

Read more https://theconversation.com/google-is-rolling-out-its-gemini-ai-chatbot-to-kids-under-13-its-a-risky-move-256204

New taxes on super didn’t get much attention in the election campaign. But they could be tricky to implement

The re-election of the Albanese government has led to renewed concern[1] about planned changes to the taxati...

The Times Features

Exclusive Murray River experiences with the PS Murray Princess

SeaLink South Australia is delighted to unveil two brand-new, limited-time cruise experiences aboard the award-winning PS Murray Princess, offering guests an extraordinary oppo...

Carrie Bickmore and Guy Sebastian’s Christmas house swap ends in a hilarious prank

Carrie Bickmore and Guy Sebastian took their celebrity friendship to the next level over summer – by swapping houses. The pair revealed on The Hit Network’s Carrie & Tommy...

Welt Schatz.com Offers Premium Membership To Elevate Users' Status

London, United Kingdom - Welt Schatz.com is a financial services firm that operates across digital platforms, focusing on expanding user benefits through practical tools and acce...

How to buy a coffee machine

For coffee lovers, having a home coffee machine can transform your daily routine, allowing you to enjoy café-quality drinks without leaving your kitchen. But with so many optio...

In the Digital Age, Online Promotion Isn't Just an Option for Small Businesses – It's a Necessity

The shift to an online-first consumer landscape means small businesses must embrace digital promotion to not only survive but thrive in 2025. From expanding reach to fostering cu...

Sorbet Balls by bubbleme Bring Bite-Sized Cool Spin to Frozen Snacking

A cool new frozen treat is rolling into the ice-cream aisle at Woolworths stores nationwide. Dairy-free, gluten-free and free from artificial colours, bubbleme Sorbet Balls ar...

Times Magazine

Senior of the Year Nominations Open

The Allan Labor Government is encouraging all Victorians to recognise the valuable contributions of older members of our community by nominating them for the 2025 Victorian Senior of the Year Awards.  Minister for Ageing Ingrid Stitt today annou...

CNC Machining Meets Stage Design - Black Swan State Theatre Company & Tommotek

When artistry meets precision engineering, incredible things happen. That’s exactly what unfolded when Tommotek worked alongside the Black Swan State Theatre Company on several of their innovative stage productions. With tight deadlines and intrica...

Uniden Baby Video Monitor Review

Uniden has released another award-winning product as part of their ‘Baby Watch’ series. The BW4501 Baby Monitor is an easy to use camera for keeping eyes and ears on your little one. The camera is easy to set up and can be mounted to the wall or a...

Top Benefits of Hiring Commercial Electricians for Your Business

When it comes to business success, there are no two ways about it: qualified professionals are critical. While many specialists are needed, commercial electricians are among the most important to have on hand. They are directly involved in upholdin...

The Essential Guide to Transforming Office Spaces for Maximum Efficiency

Why Office Fitouts MatterA well-designed office can make all the difference in productivity, employee satisfaction, and client impressions. Businesses of all sizes are investing in updated office spaces to create environments that foster collaborat...

The A/B Testing Revolution: How AI Optimized Landing Pages Without Human Input

A/B testing was always integral to the web-based marketing world. Was there a button that converted better? Marketing could pit one against the other and see which option worked better. This was always through human observation, and over time, as d...

LayBy Shopping