The Times Australia
The Times World News

.

How shoring up drones with artificial intelligence helps surf lifesavers spot sharks at the beach

  • Written by Cormac Purcell, Adjunct Senior Lecturer, UNSW Sydney
How shoring up drones with artificial intelligence helps surf lifesavers spot sharks at the beach

Australian surf lifesavers are increasingly using drones to spot sharks at the beach before they get too close to swimmers. But just how reliable are they?

Discerning whether that dark splodge in the water is a shark or just, say, seaweed isn’t always straightforward and, in reasonable conditions, drone pilots generally make the right call only 60% of the time[1]. While this has implications for public safety, it can also lead to unnecessary beach closures and public alarm.

Engineers are trying to boost the accuracy of these shark-spotting drones with artificial intelligence (AI). While they show great promise in the lab, AI systems are notoriously difficult to get right in the real world, so remain out of reach for surf lifesavers. And importantly, overconfidence in such software can have serious consequences[2].

With these challenges in mind, our team[3] set out to build the most robust[4] shark detector possible and test it in real-world conditions. By using masses of data[5], we created a highly reliable mobile app for surf lifesavers that could not only improve beach safety, but help monitor the health of Australian coastlines.

White shark being observed by a drone.
A white shark being tracked by a drone. Author provided.

Detecting dangerous sharks with drones

The New South Wales government has invested more than A$85 million[6] in shark mitigation measures over the next four years. Of all approaches on offer[7], a 2020 survey[8] showed drone-based shark surveillance is the public’s preferred method to protect beach-goers.

The state government has been trialling drones[9] as shark-spotting tools since 2016, and with Surf Life Saving NSW since 2018. Trained surf lifesaving pilots fly the drone over the ocean at a height of 60 metres, watching the live video feed on portable screens for the shape of sharks[10] swimming under the surface.

Read more: Lifeguards with drones keep us (and sharks) safe, and beach-goers agree[11]

Identifying sharks by carefully analysing the video footage in good conditions seems easy. But water clarity, sea glitter (sea-surface reflection), animal depth, pilot experience and fatigue all reduce the reliability of real-time detection to a predicted average of 60%[12]. This reliability falls further when conditions are turbid[13].

Pilots also need to confidently identify the species of shark[14] and tell the difference between dangerous and non-dangerous animals, such as rays, which are often misidentified.

Identifying shark species from the air.

AI-driven computer vision has been touted as an ideal tool to virtually “tag” sharks and other animals in the video footage streamed from the drones, and to help identify whether a species nearing the beach is cause for concern.

AI to the rescue?

Early results[15] from previous AI-enhanced shark-spotting systems[16] have suggested the problem has been solved, as these systems report detection accuracies of over 90%.

But scaling these systems to make a real-world difference across NSW beaches has been challenging.

AI systems are trained to locate and identify species using large collections of example images and perform remarkably well[17] when processing familiar scenes in the real world.

However, problems quickly arise[18] when they encounter conditions not well represented in the training data. As any regular ocean swimmer can tell you, every beach is different – the lighting, weather and water conditions can change dramatically across days and seasons.

Read more: 740,000km of fishing line and 14 billion hooks: we reveal just how much fishing gear is lost at sea each year[19]

Animals can also frequently change their position in the water column, which means their visible characteristics (such as their outline) changes, too.

All this variation makes it crucial for training data to cover the full gamut of conditions, or that AI systems be flexible enough to track the changes over time. Such challenges have been recognised for years[20], giving rise to the new discipline of “machine learning operations[21]”.

Essentially, machine learning operations explicitly recognises that AI-driven software requires regular updates to maintain its effectiveness.

Examples of the drone footage used in our huge dataset.

Building a better shark spotter

We aimed to overcome these challenges with a new shark detector mobile app. We gathered a huge dataset[22] of drone footage[23], and shark experts then spent weeks inspecting the videos, carefully tracking and labelling sharks and other marine fauna in the hours of footage.

Using this new dataset, we trained a machine learning model to recognise ten types of marine life, including different species of dangerous sharks such as great white and whaler sharks.

And then we embedded this model into a new mobile app that can highlight sharks in live drone footage and predict the species. We worked closely with the NSW government[24] and Surf Lifesaving NSW[25] to trial this app on five beaches[26] during summer 2020.

Drone flying at a beach.
A drone in surf lifesaver NSW livery preparing to go on patrol. Author provided.

Our AI shark detector did quite well. It identified dangerous sharks on a frame-by-frame basis 80% of the time, in realistic conditions.

We deliberately went out of our way to make our tests difficult by challenging the AI to run on unseen data taken at different times of year, or from different-looking beaches. These critical tests on “external data” are often omitted in AI research[27].

A more detailed analysis turned up common-sense limitations: white, whaler and bull sharks are difficult to tell apart because they look similar, while small animals (such as turtles and rays) are harder to detect in general.

Spurious detections (like mistaking seaweed as a shark) are a real concern for beach managers, but we found the AI could easily be “tuned” to eliminate these by showing it empty ocean scenes of each beach.

Seaweed identified as sharks.
Example of where the AI gets it wrong - seaweed identified as sharks. Author provided

The future of AI for shark spotting

In the short term, AI is now mature enough to be deployed in drone-based shark-spotting operations across Australian beaches. But, unlike regular software, it will need to be monitored and updated frequently to maintain its high reliability of detecting dangerous sharks.

An added bonus is that such a machine learning system for spotting sharks would also continually collect valuable ecological data on the health of our coastline and marine fauna.

In the longer term, getting the AI to look at how sharks swim and using new AI technology that learns on-the-fly[28] will make AI shark detection even more reliable and easy to deploy.

The NSW government[29] has new drone trials for the coming summer, testing the usefulness of efficient long-range flights that can cover more beaches.

AI can play a key role in making these flights more effective, enabling greater reliability in drone surveillance, and may eventually lead to fully-automated shark-spotting operations and trusted automatic alerts.

Read more: Sleeping fish? From sharks to salmon, guppies to groupers, here's how they grab a snooze[30]

The authors acknowledge the substantial contributions from Dr Andrew Colefax and Dr Andrew Walsh at Sci-eye[31].

References

  1. ^ 60% of the time (www.sciencedirect.com)
  2. ^ serious consequences (arstechnica.com)
  3. ^ our team (cormacpurcell.net)
  4. ^ build the most robust (www.frontiersin.org)
  5. ^ masses of data (www.forbes.com)
  6. ^ invested more than A$85 million (www.dpi.nsw.gov.au)
  7. ^ on offer (www.sharksmart.nsw.gov.au)
  8. ^ 2020 survey (theconversation.com)
  9. ^ trialling drones (www.dpi.nsw.gov.au)
  10. ^ shape of sharks (www.youtube.com)
  11. ^ Lifeguards with drones keep us (and sharks) safe, and beach-goers agree (theconversation.com)
  12. ^ a predicted average of 60% (www.sciencedirect.com)
  13. ^ are turbid (www.publish.csiro.au)
  14. ^ the species of shark (www.youtube.com)
  15. ^ Early results (theconversation.com)
  16. ^ previous AI-enhanced shark-spotting systems (www.mdpi.com)
  17. ^ perform remarkably well (image-net.org)
  18. ^ problems quickly arise (arxiv.org)
  19. ^ 740,000km of fishing line and 14 billion hooks: we reveal just how much fishing gear is lost at sea each year (theconversation.com)
  20. ^ recognised for years (proceedings.neurips.cc)
  21. ^ machine learning operations (ml-ops.org)
  22. ^ huge dataset (www.sharksmart.nsw.gov.au)
  23. ^ drone footage (www.youtube.com)
  24. ^ NSW government (www.sharksmart.nsw.gov.au)
  25. ^ Surf Lifesaving NSW (www.surflifesaving.com.au)
  26. ^ five beaches (www.surflifesaving.com.au)
  27. ^ often omitted in AI research (www.nature.com)
  28. ^ learns on-the-fly (www.tensorflow.org)
  29. ^ The NSW government (www.sharksmart.nsw.gov.au)
  30. ^ Sleeping fish? From sharks to salmon, guppies to groupers, here's how they grab a snooze (theconversation.com)
  31. ^ Sci-eye (scieye.com.au)

Read more https://theconversation.com/how-shoring-up-drones-with-artificial-intelligence-helps-surf-lifesavers-spot-sharks-at-the-beach-192498

Times Magazine

Building an AI-First Culture in Your Company

AI isn't just something to think about anymore - it's becoming part of how we live and work, whether we like it or not. At the office, it definitely helps us move faster. But here's the thing: just using tools like ChatGPT or plugging AI into your wo...

Data Management Isn't Just About Tech—Here’s Why It’s a Human Problem Too

Photo by Kevin Kuby Manuel O. Diaz Jr.We live in a world drowning in data. Every click, swipe, medical scan, and financial transaction generates information, so much that managing it all has become one of the biggest challenges of our digital age. Bu...

Headless CMS in Digital Twins and 3D Product Experiences

Image by freepik As the metaverse becomes more advanced and accessible, it's clear that multiple sectors will use digital twins and 3D product experiences to visualize, connect, and streamline efforts better. A digital twin is a virtual replica of ...

The Decline of Hyper-Casual: How Mid-Core Mobile Games Took Over in 2025

In recent years, the mobile gaming landscape has undergone a significant transformation, with mid-core mobile games emerging as the dominant force in app stores by 2025. This shift is underpinned by changing user habits and evolving monetization tr...

Understanding ITIL 4 and PRINCE2 Project Management Synergy

Key Highlights ITIL 4 focuses on IT service management, emphasising continual improvement and value creation through modern digital transformation approaches. PRINCE2 project management supports systematic planning and execution of projects wit...

What AI Adoption Means for the Future of Workplace Risk Management

Image by freepik As industrial operations become more complex and fast-paced, the risks faced by workers and employers alike continue to grow. Traditional safety models—reliant on manual oversight, reactive investigations, and standardised checklist...

The Times Features

Is our mental health determined by where we live – or is it the other way round? New research sheds more light

Ever felt like where you live is having an impact on your mental health? Turns out, you’re not imagining things. Our new analysis[1] of eight years of data from the New Zeal...

Going Off the Beaten Path? Here's How to Power Up Without the Grid

There’s something incredibly freeing about heading off the beaten path. No traffic, no crowded campsites, no glowing screens in every direction — just you, the landscape, and the...

West HQ is bringing in a season of culinary celebration this July

Western Sydney’s leading entertainment and lifestyle precinct is bringing the fire this July and not just in the kitchen. From $29 lobster feasts and award-winning Asian banque...

What Endo Took and What It Gave Me

From pain to purpose: how one woman turned endometriosis into a movement After years of misdiagnosis, hormone chaos, and major surgery, Jo Barry was done being dismissed. What beg...

Why Parents Must Break the Silence on Money and Start Teaching Financial Skills at Home

Australia’s financial literacy rates are in decline, and our kids are paying the price. Certified Money Coach and Financial Educator Sandra McGuire, who has over 20 years’ exp...

Australia’s Grill’d Transforms Operations with Qlik

Boosting Burgers and Business Clean, connected data powers real-time insights, smarter staffing, and standout customer experiences Sydney, Australia, 14 July 2025 – Qlik®, a g...