Google AI
The Times Australia

Times Media

what is a ‘deep network’ outage and what may have caused it?

  • Written by: Paul Haskell-Dowland, Professor of Cyber Security Practice, Edith Cowan University
Optus Help post from X, formerly Twitter

Optus customers woke up this morning to find they were unable to get their social media fix, and they weren’t happy. Around 4am AEDT, customers started to report an inability to access[1] both mobile and home internet services.

Optus advised it was investigating the issue, with reports emerging around[2] midday of some services coming back online.

Optus Help post from X, formerly Twitter
Optus Help/X, CC BY-SA[3] Around 12.30pm, Optus chief executive Kelly Bayer Rosmarin told radio 2GB the path to restoration[4] had been found, nearly nine hours after the blackout began. The outage, one of the largest in Australia’s history, sent alarm bells ringing across the country. With a number of[5] smaller mobile network providers reselling the Optus network, including Aussie Broadband, Amaysim, CatchConnect, Coles Mobile, Dodo, Moose Mobile and more[6], the impact was felt far and wide. As the morning progressed, the impact grew. Health and emergency services were unable to communicate, trains in Melbourne[7] were brought to a halt and small businesses across the nation were unable to use Optus EFTPOS. Fortunately, Optus users could still use roaming to call 000[8] if they were within the coverage of other telecommunication service providers. Read more: In a crisis, Optus appears to be ignoring Communications 101[9] What is a ‘deep network’ problem? Earlier today Minister for Communications Michelle Rowland described the incident as a “deep network”[10] problem. Telecommunications networks include three components: the core, transit and access networks. You can think of the core network[11] as the systems that allow customers’ devices to connect to and access phone and internet services. The transit network connects the core to the access networks using optical fibre cables. The access networks include the local infrastructure found in suburbs – including the mobile phone towers. Core network outages can occur when equipment or cables fail, when there is a software fault, or when a cyberattack occurs. The most common reason for a software fault is when a patch or update is applied and it has an unintended outcome, such as causing one or more of the core network systems to fail.
downdetector.com.au[12] What could have caused this? Although Optus hasn’t give any indications as to the exact cause of the outage[13], Bayer Rosmarin said it was[14] unlikely a cyberattack was the cause: There is no indication that it is anything to do with spyware at this stage. At the same time, experts have noted mobile cell towers are working, and there seems to be no damage to the underlying fibre optic network. This means we can probably rule out an issue in the transit or access networks. The scale and speed with which the impact hit (and the somewhat specific timing) indicates the culprit was likely a problem in the core network. It’s very possible a software or system update was responsible. Such updates or changes often happen out of business hours to have minimal impact. They typically involve a short period of downtime – a “scheduled outage” – which goes unnoticed by customers. It could be, as some reports have speculated[15], the Optus outage was an unplanned consequence of a planned system change, such as a planned update or outage. When these processes go wrong, they can go spectacularly wrong! A radio and 5G tower against a blue sky The mobile network distributed via cell towers provides both phone calls and data to customers. Daria Nipot/Shutterstock[16] As for how such a fault may happen, it is likely due to human error (especially since 4am is a time you might expect engineers to be carrying out patch work). However, it could also be a result of other factors, such as a hardware fault that then causes a software failure. Another possibility is a fault in an accounting or user management system, such as no longer being able to attribute costs or verify users’ identities properly. Issues in back-end billing and management systems can generate a cascade of failures throughout the rest of a network. In such cases, a simple bug in the system can impact everyone connected to the network. How will this be fixed? Optus engineers will be actively investigating the cause of the outage. You might be imagining someone scurrying around with wires in their hands trying to find the one that isn’t plugged in – but in reality this will be a lengthy process that involves examining various systems and software configurations to find the culprit. For Optus, the hard work will continue after the fix is in place to ensure it doesn’t happen again. And perhaps an even more difficult challenge will be convincing the public this was an isolated incident – one that has once again highlighted how vulnerable our massively connected systems are to (even single) points of failure[17]. Speaking on 3AW Afternoons, Bayer Rosmarin said[18]: We are looking at what we can do to say thank you to our customers for their patience. Optus is likely to pay compensation to customers. For residential customers this may be in the form of a reduced bill. For business customers, the compensation would be linked with their service-level agreements. In other words, the specific penalties for Optus will be based on individual agreements it has made with various parties using or sharing its services. Beyond this, it’s highly likely today’s events have dealt a massive blow to Optus’s reputation – especially when considered alongside last year’s Optus data breach[19]. Read more: Optus says it needed to keep identity data for six years. But did it really?[20] References^ inability to access (www.abc.net.au)^ reports emerging around (www.smh.com.au)^ CC BY-SA (creativecommons.org)^ path to restoration (www.9news.com.au)^ a number of (www.theguardian.com)^ and more (whirlpool.net.au)^ trains in Melbourne (7news.com.au)^ call 000 (amta.org.au)^ In a crisis, Optus appears to be ignoring Communications 101 (theconversation.com)^ deep network” (www.abc.net.au)^ core network (www.tatacommunications.com)^ downdetector.com.au (downdetector.com.au)^ exact cause of the outage (www.abc.net.au)^ said it was (www.theguardian.com)^ reports have speculated (www.heraldsun.com.au)^ Daria Nipot/Shutterstock (www.shutterstock.com)^ points of failure (www.theaustralian.com.au)^ Bayer Rosmarin said (www.3aw.com.au)^ Optus data breach (theconversation.com)^ Optus says it needed to keep identity data for six years. But did it really? (theconversation.com)

Read more https://theconversation.com/optus-blackout-explained-what-is-a-deep-network-outage-and-what-may-have-caused-it-217266

Times Magazine

Australia’s AI Productivity Push Needs a Manager Audit

Australia’s business use of artificial intelligence has accelerated quickly. The Australian Bureau...

MIST raises $3.5 million to advance financial technology supporting Australia’s international students

Australian student fintech MIST has secured a $3.5 million investment from DoxAI, providing fresh ...

Using AI to Do Your Investment Taxes? Sharesight Says Think Again

The Australian Taxation Office (ATO) has issued a fresh warning this tax season against relying on...

Technology

Australia’s AI Productivity Push Ne…

Australia’s business use of artificial intelligence has accelerated quickly. The Australian Bureau...

Local News

Psychology clinic in Tasmania opens…

In response to Tasmania’s growing mental health crisis, a new purpose-built, multi-disciplinary me...

Culture

Australia’s AI Productivity Push Needs a Mana…

Australia’s business use of artificial intelligence has accelerated quickly. The Australian Bureau...

Travel

Korea Tourism Organization Invites Australian…

The Korea Tourism Organization (KTO) has launched Korea Unlocks More of You, a new national campai...

The Times Features

Food Hygiene at Home: Simple Habits That Can Prevent a …

Preparing meals at home is one of life's pleasures, but even the cleanest kitchens can become a so...

Junction Arts Festival Returns to Transform Launceston …

Launceston will once again become a platform for bold art, performance, music and shared experienc...

As Aussies Ask More of Their Food, Grill'd Unveils…

Because a protein hit shouldn’t mean a flavour trade-off.Wellbeing has become the defining obsession...