Google AI
The Times Australia

Times Media

what is a ‘deep network’ outage and what may have caused it?

  • Written by: Paul Haskell-Dowland, Professor of Cyber Security Practice, Edith Cowan University
Optus Help post from X, formerly Twitter

Optus customers woke up this morning to find they were unable to get their social media fix, and they weren’t happy. Around 4am AEDT, customers started to report an inability to access[1] both mobile and home internet services.

Optus advised it was investigating the issue, with reports emerging around[2] midday of some services coming back online.

Optus Help post from X, formerly Twitter
Optus Help/X, CC BY-SA[3] Around 12.30pm, Optus chief executive Kelly Bayer Rosmarin told radio 2GB the path to restoration[4] had been found, nearly nine hours after the blackout began. The outage, one of the largest in Australia’s history, sent alarm bells ringing across the country. With a number of[5] smaller mobile network providers reselling the Optus network, including Aussie Broadband, Amaysim, CatchConnect, Coles Mobile, Dodo, Moose Mobile and more[6], the impact was felt far and wide. As the morning progressed, the impact grew. Health and emergency services were unable to communicate, trains in Melbourne[7] were brought to a halt and small businesses across the nation were unable to use Optus EFTPOS. Fortunately, Optus users could still use roaming to call 000[8] if they were within the coverage of other telecommunication service providers. Read more: In a crisis, Optus appears to be ignoring Communications 101[9] What is a ‘deep network’ problem? Earlier today Minister for Communications Michelle Rowland described the incident as a “deep network”[10] problem. Telecommunications networks include three components: the core, transit and access networks. You can think of the core network[11] as the systems that allow customers’ devices to connect to and access phone and internet services. The transit network connects the core to the access networks using optical fibre cables. The access networks include the local infrastructure found in suburbs – including the mobile phone towers. Core network outages can occur when equipment or cables fail, when there is a software fault, or when a cyberattack occurs. The most common reason for a software fault is when a patch or update is applied and it has an unintended outcome, such as causing one or more of the core network systems to fail.
downdetector.com.au[12] What could have caused this? Although Optus hasn’t give any indications as to the exact cause of the outage[13], Bayer Rosmarin said it was[14] unlikely a cyberattack was the cause: There is no indication that it is anything to do with spyware at this stage. At the same time, experts have noted mobile cell towers are working, and there seems to be no damage to the underlying fibre optic network. This means we can probably rule out an issue in the transit or access networks. The scale and speed with which the impact hit (and the somewhat specific timing) indicates the culprit was likely a problem in the core network. It’s very possible a software or system update was responsible. Such updates or changes often happen out of business hours to have minimal impact. They typically involve a short period of downtime – a “scheduled outage” – which goes unnoticed by customers. It could be, as some reports have speculated[15], the Optus outage was an unplanned consequence of a planned system change, such as a planned update or outage. When these processes go wrong, they can go spectacularly wrong! A radio and 5G tower against a blue sky The mobile network distributed via cell towers provides both phone calls and data to customers. Daria Nipot/Shutterstock[16] As for how such a fault may happen, it is likely due to human error (especially since 4am is a time you might expect engineers to be carrying out patch work). However, it could also be a result of other factors, such as a hardware fault that then causes a software failure. Another possibility is a fault in an accounting or user management system, such as no longer being able to attribute costs or verify users’ identities properly. Issues in back-end billing and management systems can generate a cascade of failures throughout the rest of a network. In such cases, a simple bug in the system can impact everyone connected to the network. How will this be fixed? Optus engineers will be actively investigating the cause of the outage. You might be imagining someone scurrying around with wires in their hands trying to find the one that isn’t plugged in – but in reality this will be a lengthy process that involves examining various systems and software configurations to find the culprit. For Optus, the hard work will continue after the fix is in place to ensure it doesn’t happen again. And perhaps an even more difficult challenge will be convincing the public this was an isolated incident – one that has once again highlighted how vulnerable our massively connected systems are to (even single) points of failure[17]. Speaking on 3AW Afternoons, Bayer Rosmarin said[18]: We are looking at what we can do to say thank you to our customers for their patience. Optus is likely to pay compensation to customers. For residential customers this may be in the form of a reduced bill. For business customers, the compensation would be linked with their service-level agreements. In other words, the specific penalties for Optus will be based on individual agreements it has made with various parties using or sharing its services. Beyond this, it’s highly likely today’s events have dealt a massive blow to Optus’s reputation – especially when considered alongside last year’s Optus data breach[19]. Read more: Optus says it needed to keep identity data for six years. But did it really?[20] References^ inability to access (www.abc.net.au)^ reports emerging around (www.smh.com.au)^ CC BY-SA (creativecommons.org)^ path to restoration (www.9news.com.au)^ a number of (www.theguardian.com)^ and more (whirlpool.net.au)^ trains in Melbourne (7news.com.au)^ call 000 (amta.org.au)^ In a crisis, Optus appears to be ignoring Communications 101 (theconversation.com)^ deep network” (www.abc.net.au)^ core network (www.tatacommunications.com)^ downdetector.com.au (downdetector.com.au)^ exact cause of the outage (www.abc.net.au)^ said it was (www.theguardian.com)^ reports have speculated (www.heraldsun.com.au)^ Daria Nipot/Shutterstock (www.shutterstock.com)^ points of failure (www.theaustralian.com.au)^ Bayer Rosmarin said (www.3aw.com.au)^ Optus data breach (theconversation.com)^ Optus says it needed to keep identity data for six years. But did it really? (theconversation.com)

Read more https://theconversation.com/optus-blackout-explained-what-is-a-deep-network-outage-and-what-may-have-caused-it-217266

Times Magazine

Still Want to Change Gears? The New Cars Keeping the Manual Alive in Australia

For decades, learning to drive meant mastering the clutch pedal, selecting the right gear and find...

SpaceX changed spaceflight. Now China is proving reusable rockets are the new battleground.

When SpaceX first landed a Falcon 9 booster vertically on a floating drone ship, many experts desc...

Hybrid, Plug-in Hybrid or Electric? Understanding the Differences

Buying a new car has become more complicated than choosing between petrol and diesel. Today's buye...

Technology

SpaceX changed spaceflight. Now Chi…

When SpaceX first landed a Falcon 9 booster vertically on a floating drone ship, many experts desc...

Local News

Fremantle Ports to trial project to…

Fremantle Ports has partnered with Byssal and DevelopmentWA to trial an innovative nature-based pilo...

Culture

Healthy Eating: What Does a Science-Based Die…

After years of changing food trends—from low-fat to low-carbohydrate, detoxes and "superfoods"—it ...

Travel

Santorini: Is Greece's Most Famous Islan…

Whitewashed villages perched on volcanic cliffs. Blue-domed churches overlooking the Aegean Sea. S...

The Times Features

IKEA: More Than Furniture—A Complete Design System for …

For many Australians, IKEA is simply a place to buy affordable furniture. Look more closely, howe...

Healthy Eating: What Does a Science-Based Diet Actually…

After years of changing food trends—from low-fat to low-carbohydrate, detoxes and "superfoods"—it ...

Healthy Living: Can Exercise and Good Nutrition Help Yo…

Most people begin exercising or improving their diet with a specific goal in mind. It may be to lo...