Google AI
The Times Australia

Times Media

what is a ‘deep network’ outage and what may have caused it?

  • Written by: Paul Haskell-Dowland, Professor of Cyber Security Practice, Edith Cowan University
Optus Help post from X, formerly Twitter

Optus customers woke up this morning to find they were unable to get their social media fix, and they weren’t happy. Around 4am AEDT, customers started to report an inability to access[1] both mobile and home internet services.

Optus advised it was investigating the issue, with reports emerging around[2] midday of some services coming back online.

Optus Help post from X, formerly Twitter
Optus Help/X, CC BY-SA[3] Around 12.30pm, Optus chief executive Kelly Bayer Rosmarin told radio 2GB the path to restoration[4] had been found, nearly nine hours after the blackout began. The outage, one of the largest in Australia’s history, sent alarm bells ringing across the country. With a number of[5] smaller mobile network providers reselling the Optus network, including Aussie Broadband, Amaysim, CatchConnect, Coles Mobile, Dodo, Moose Mobile and more[6], the impact was felt far and wide. As the morning progressed, the impact grew. Health and emergency services were unable to communicate, trains in Melbourne[7] were brought to a halt and small businesses across the nation were unable to use Optus EFTPOS. Fortunately, Optus users could still use roaming to call 000[8] if they were within the coverage of other telecommunication service providers. Read more: In a crisis, Optus appears to be ignoring Communications 101[9] What is a ‘deep network’ problem? Earlier today Minister for Communications Michelle Rowland described the incident as a “deep network”[10] problem. Telecommunications networks include three components: the core, transit and access networks. You can think of the core network[11] as the systems that allow customers’ devices to connect to and access phone and internet services. The transit network connects the core to the access networks using optical fibre cables. The access networks include the local infrastructure found in suburbs – including the mobile phone towers. Core network outages can occur when equipment or cables fail, when there is a software fault, or when a cyberattack occurs. The most common reason for a software fault is when a patch or update is applied and it has an unintended outcome, such as causing one or more of the core network systems to fail.
downdetector.com.au[12] What could have caused this? Although Optus hasn’t give any indications as to the exact cause of the outage[13], Bayer Rosmarin said it was[14] unlikely a cyberattack was the cause: There is no indication that it is anything to do with spyware at this stage. At the same time, experts have noted mobile cell towers are working, and there seems to be no damage to the underlying fibre optic network. This means we can probably rule out an issue in the transit or access networks. The scale and speed with which the impact hit (and the somewhat specific timing) indicates the culprit was likely a problem in the core network. It’s very possible a software or system update was responsible. Such updates or changes often happen out of business hours to have minimal impact. They typically involve a short period of downtime – a “scheduled outage” – which goes unnoticed by customers. It could be, as some reports have speculated[15], the Optus outage was an unplanned consequence of a planned system change, such as a planned update or outage. When these processes go wrong, they can go spectacularly wrong! A radio and 5G tower against a blue sky The mobile network distributed via cell towers provides both phone calls and data to customers. Daria Nipot/Shutterstock[16] As for how such a fault may happen, it is likely due to human error (especially since 4am is a time you might expect engineers to be carrying out patch work). However, it could also be a result of other factors, such as a hardware fault that then causes a software failure. Another possibility is a fault in an accounting or user management system, such as no longer being able to attribute costs or verify users’ identities properly. Issues in back-end billing and management systems can generate a cascade of failures throughout the rest of a network. In such cases, a simple bug in the system can impact everyone connected to the network. How will this be fixed? Optus engineers will be actively investigating the cause of the outage. You might be imagining someone scurrying around with wires in their hands trying to find the one that isn’t plugged in – but in reality this will be a lengthy process that involves examining various systems and software configurations to find the culprit. For Optus, the hard work will continue after the fix is in place to ensure it doesn’t happen again. And perhaps an even more difficult challenge will be convincing the public this was an isolated incident – one that has once again highlighted how vulnerable our massively connected systems are to (even single) points of failure[17]. Speaking on 3AW Afternoons, Bayer Rosmarin said[18]: We are looking at what we can do to say thank you to our customers for their patience. Optus is likely to pay compensation to customers. For residential customers this may be in the form of a reduced bill. For business customers, the compensation would be linked with their service-level agreements. In other words, the specific penalties for Optus will be based on individual agreements it has made with various parties using or sharing its services. Beyond this, it’s highly likely today’s events have dealt a massive blow to Optus’s reputation – especially when considered alongside last year’s Optus data breach[19]. Read more: Optus says it needed to keep identity data for six years. But did it really?[20] References^ inability to access (www.abc.net.au)^ reports emerging around (www.smh.com.au)^ CC BY-SA (creativecommons.org)^ path to restoration (www.9news.com.au)^ a number of (www.theguardian.com)^ and more (whirlpool.net.au)^ trains in Melbourne (7news.com.au)^ call 000 (amta.org.au)^ In a crisis, Optus appears to be ignoring Communications 101 (theconversation.com)^ deep network” (www.abc.net.au)^ core network (www.tatacommunications.com)^ downdetector.com.au (downdetector.com.au)^ exact cause of the outage (www.abc.net.au)^ said it was (www.theguardian.com)^ reports have speculated (www.heraldsun.com.au)^ Daria Nipot/Shutterstock (www.shutterstock.com)^ points of failure (www.theaustralian.com.au)^ Bayer Rosmarin said (www.3aw.com.au)^ Optus data breach (theconversation.com)^ Optus says it needed to keep identity data for six years. But did it really? (theconversation.com)

Read more https://theconversation.com/optus-blackout-explained-what-is-a-deep-network-outage-and-what-may-have-caused-it-217266

Times Magazine

Australia Needs Permission Budgets for AI Agents

The Times recently argued that Australia should keep building the data centres the AI economy requ...

Nikon Is Developing Nine New Cinema Lenses and a Major ZR Firmware Update

Nikon is developing a new series of nine NIKKOR Z CINEMA T1.9 VV cinema lenses, designed for cinem...

The Hormuz conflict enters a more dangerous phase — and Australia will pay for every voyage

The conflict around Iran and the Strait of Hormuz has entered a more dangerous phase, with the Uni...

Technology

Australia Needs Permission Budgets …

The Times recently argued that Australia should keep building the data centres the AI economy requ...

Local News

Fitstop Global Games to Bring 1,000…

The Australian-born fitness brand is bringing its global competition home, with athletes from across...

Culture

Two Years Later — a love story that quietly a…

Two Years Later looks, initially, like a romantic television series. It is considerably more inte...

Travel

School holiday pricing: fair market economics…

Every Australian family with school-aged children knows the pattern. Look at an airfare, hotel ro...

The Times Features

Two Years Later — a love story that quietly asks what r…

Two Years Later looks, initially, like a romantic television series. It is considerably more inte...

Free Family Fun Day Brings K-Pop, Face Painting and Sch…

K-Pop Demon Hunters kids disco and free face painting headline a day of activities for local familie...

Four Free Family Days Put the Fun Back Into School Holi…

Batmobile, Bluey & Bingo, a reptile show and a petting zoo across the September/October break ...