Google AI
The Times Australia

Times Media Advertising

Banning kids from social media doesn’t make online platforms safer. Here’s what will do that

  • Written by: Joel Scanlan, Senior Lecturer in Cybersecurity and Privacy, University of Tasmania




The tech industry’s unofficial motto for two decades was “move fast and break things”. It was a philosophy that broke more than just taxi monopolies[1] or hotel chains[2]. It also constructed a digital world filled with risks for our most vulnerable.

In the 2024–25 financial year alone, the Australian Centre to Counter Child Exploitation received nearly 83,000 reports[3] of online child sexual exploitation material (CSAM), primarily on mainstream platforms – a 41% increase from the year before.

Additionally, links between adolescent usage of social media and a range of harms have been found[4], such as adverse mental health outcomes, substance abuse and risky sexual behaviours. These findings represent the failure of a digital ecosystem built on profit[5] rather than protection.

With the federal government’s ban on social media accounts for under-16s taking effect this week, as well as age assurance[6] for logged-in search engine users on December 27[7] and adult content on March 9 2026[8], we have reached a landmark moment – but we must be clear about what this regulation achieves and what it ignores.

The ban may keep some children out (if they don’t circumvent it), but it does nothing to fix the harmful architecture awaiting them upon return. Nor does it take steps to modify the harmful behaviour of some adult users. We need meaningful change toward a digital duty of care[9], where platforms are legally required to anticipate and mitigate harm.

The need for safety by design

Currently, online safety often relies on a “whack-a-mole” approach: platforms wait for users to report harmful content, then moderators remove it. It is reactive, slow, and often traumatising for the human moderators[10] involved.

To truly fix this, we need safety by design. This principle demands that safety features be embedded in a platform’s core architecture. It moves beyond simply blocking access, to questioning why the platform allows harmful pathways to exist in the first place.

We are already seeing this when platforms with histories of harm[11] add new features – such as “trusted connections” on Roblox[12] that limits in-game connections only to people the child also knows in the real world. This feature should have existed from the start.

At the CSAM Deterrence Centre, led by Jesuit Social Service in partnership with the University of Tasmania, our research[13] challenges the industry narrative that safety is “too hard” or “too costly” to implement.

In fact, we have found that simple, well-designed interventions can disrupt harmful behaviours without breaking the user experience for everyone else.

Disrupting harm

One of our most significant findings comes from a partnership with one of the world’s largest adult sites, Pornhub. In the first publicly evaluated deterrence intervention, when a user searched for keywords associated with child abuse, they didn’t just hit a blank wall. They triggered a warning message and a chatbot directing the user to therapeutic help.

We observed a decrease in searches for illegal material, but also more than 80% of users who encountered this intervention did not attempt to search for that content on Pornhub again in that session[14].

Banning kids from social media doesn’t make online platforms safer. Here’s what will do that
Graph showing the number of users who searched for a term related to child sexual exploitation material after receiving a warning message. Author provided (no reuse)

This data, consistent with findings from three randomised control trials[15] we have undertaken on Australian males aged 18–40, proves that warning messages work.

It is also in line with another finding: Jesuit Social Service’s Stop It Now (Australia)[16], which provides therapeutic services to those concerned about their feelings towards children, received a dramatic increase in web referrals after the warning message Google shows in search results for child abuse material was improved earlier this year.

Banning kids from social media doesn’t make online platforms safer. Here’s what will do that
The warning that Google displays in Australia directing users to Stop It Now if they search for illegal material relating to child sexual exploitation.

By interrupting the user’s flow with a clear deterrent message, we can stop a harmful thought from becoming a harmful action. This is safety by design, using a platform’s own interface to protect the community.

Holding platforms responsible

This is why it’s so vital to include a digital duty of care in Australia’s online safety legislation[17], something the government committed to earlier this year.

Instead of users entering at their own risk, online platforms would be legally responsible for identifying and mitigating risks – such as algorithms that recommend harmful content or search functions that help users access illegal material.

Platforms can start making meaningful changes today by considering how their platforms could facilitate harm, and building in protections.

Examples include implementing grooming detection (enabling the automated detection of perpetrators trying to exploit children), blocking the sharing of known abuse imagery and videos and the links to websites that host such material, as well as proactively removing harm pathways that target the vulnerable – such as children online being able to interact with adults not known to them.

As our research shows, deterrence messaging plays a role too – displaying clear warnings when users search for harmful terms is highly effective. Tech companies should partner with researchers[18] and non-profit organisations to test what works, sharing data rather than hiding it.

The “move fast and break things” era is over. We need a cultural shift where safety online is treated as an essential feature, not an optional add-on. The technology to make these platforms safer already exists. And evidence shows that safety by design can have an impact. The only thing missing is the will to implement it.

References

  1. ^ taxi monopolies (www.abc.net.au)
  2. ^ hotel chains (www.library.hbs.edu)
  3. ^ nearly 83,000 reports (www.afp.gov.au)
  4. ^ a range of harms have been found (doi.org)
  5. ^ built on profit (theconversation.com)
  6. ^ age assurance (www.esafety.gov.au)
  7. ^ on December 27 (www.abc.net.au)
  8. ^ adult content on March 9 2026 (www.dundaslawyers.com.au)
  9. ^ a digital duty of care (minister.infrastructure.gov.au)
  10. ^ traumatising for the human moderators (theconversation.com)
  11. ^ platforms with histories of harm (theconversation.com)
  12. ^ “trusted connections” on Roblox (theconversation.com)
  13. ^ our research (www.csamdeterrence.com)
  14. ^ did not attempt to search for that content on Pornhub again in that session (www.iwf.org.uk)
  15. ^ randomised control trials (doi.org)
  16. ^ Stop It Now (Australia) (www.stopitnow.org.au)
  17. ^ in Australia’s online safety legislation (minister.infrastructure.gov.au)
  18. ^ should partner with researchers (www.csamdeterrence.com)

Read more https://theconversation.com/banning-kids-from-social-media-doesnt-make-online-platforms-safer-heres-what-will-do-that-271103

Nationals move Bill to protect women. Sall Grover interview

Matt Canavan  All good. Look, well, it's great to be here with my friend and colleague, Alison Penfold, and als...

Times Magazine

How Australian Businesses Are Using AI To Cut Costs And Improve Efficiency

Artificial intelligence was once viewed by many small business owners as something futuristic, exp...

Quickest Way of Getting Rid of Your Old Cars in Brisbane?

If you are done searching for a practical solution for quickly getting rid of your old car, this w...

The Human Supplement Craze Has Officially Gone to the Dogs (Literally)

Australians’ appetite for supplements is no longer limited to their own vitamin cabinets. New reta...

AI Guilt: It’s Real — But it is irrational

Artificial intelligence is rapidly becoming one of the most powerful tools ever made available to ...

Australians Are Keeping Their Cars Longer — And It’s Changing The Market

Australia’s car market is undergoing a subtle but important transformation. People are keeping th...

Streaming Fatigue: Australians Overwhelmed By Subscriptions

Streaming was once supposed to simplify entertainment. Instead, many Australians now feel overwhe...

Why Shopping Centres No Longer Feel Exciting

There was a time when going to the shopping centre felt like an event. Families spent entire Satu...

Harry And Meghan: Less Powerful As Royals, More Powerful As Content

For all the claims of “Harry and Meghan fatigue”, the world’s media still cannot stop talking abou...

Surprising things Aussies do to ‘manifest’ winning a dream home as Australia’s biggest ever prize unveiled

Dream Home Art Union has unveiled its biggest prize in its 70-year history supporting veterans - a...

The Times Features

Australia’s Changing Family Dynamic: When Adult Childre…

Australia’s housing affordability crisis is no longer simply an economic issue. It is reshaping t...

ASX Movements Since Labor’s Budget: What Investors Are …

Australia’s share market has spent recent weeks digesting the implications of Labor’s federal budg...

QLD Day

On Saturday 6 June, parkrun events across the state will be a sea of maroon, with communities  str...

NAGNATA: ‘FUTURE = FIBRE’ — Movement 21 at AFW 2026 …

Photography by Cesar OcampoOn Day 3 of Australian Fashion Week 2026, the energy at the runway shifte...

Flu Season in Australia: Why Health Authorities Are Tak…

As winter settles across Australia, so too does the annual flu season — a recurring health challen...

Smart Supermarket Shopping: The Money-Saving Hacks Aust…

Australians are becoming smarter supermarket shoppers. Rising grocery prices, higher mortgage rep...

Kmart’s Homewares Revolution: How a Discount Retailer B…

There was a time when many Australians viewed Kmart as the place to buy low-cost basics, school su...

“People Are Spending Less”: Small Businesses Feel Austr…

Sometimes the real state of the economy is not found in Treasury papers, Reserve Bank statements o...

The Arrival of Winter: More Than Just a Date on the Cal…

Winter arrives quietly in Australia. There is no dramatic wall of snow sweeping across the nation ...