The Times Australia
The Times World News

.

Scientists are turning data into sound to listen to the whispers of the universe (and more)

  • Written by Jeffrey Cooke, Professor, Centre for Astrophysics and Supercomputing, Swinburne University of Technology
Scientists are turning data into sound to listen to the whispers of the universe (and more)

We often think of astronomy as a visual science with beautiful images of the universe. However, astronomers use a wide range of analysis tools beyond images to understand nature at a deeper level.

Data sonification is the process of converting data into sound. It has powerful applications in research, education and outreach, and also enables blind and visually impaired communities to understand plots, images and other data.

Its use as a tool in science is still in its early stages – but astronomy groups are leading the way.

In a paper[1] published in Nature Astronomy, my colleagues and I discuss the current state of data sonification in astronomy and other fields, provide an overview of 100 sound-based projects[2] and explore its future directions.

The cocktail party effect

Imagine this scene: you’re at a crowded party that’s quite noisy. You don’t know anyone and they’re all speaking a language you can’t understand – not good. Then you hear bits of a conversation in a far corner in your language. You focus on it and head over to introduce yourself.

While you may have never experienced such a party, the thought of hearing a recognisable voice or language in a noisy room is familiar. The ability of the human ear and brain to filter out undesired sounds and retrieve desired sounds is called the “cocktail party effect[3]”.

Similarly, science is always pushing the boundaries of what can be detected, which often requires extracting very faint signals from noisy data. In astronomy we often push to find the faintest, farthest or most fleeting of signals. Data sonification helps us to push these boundaries further.

The video below provides examples of how sonification can help researchers discern faint signals in data. It features the sonification of nine bursts from a repeating fast radio burst called FRB121102.

Casey Law/Youtube.

Fast radio bursts are millisecond bursts of radio emission that can be detected halfway across the universe. We don’t yet know what causes them. Detecting them in other wavelengths is the key to understanding their nature.

Read more: A brief history: what we know so far about fast radio bursts across the universe[4]

Too much of a good thing

When we explore the universe with telescopes, we find it’s full of cataclysmic explosions including the supernova deaths of stars, mergers of black holes and neutron stars that create gravitational waves, and fast radio bursts.

Here you can listen to the merger of two black holes.

LIGO/YouTube.

And the merger of two neutron stars.

LIGO/YouTube.

These events allow us to understand extreme physics at the highest-known energies and densities. They help us to measure the expansion rate of the universe and how much matter it contains, and to determine where and how the elements were created, among other things.

Upcoming facilities such as the Rubin Observatory and the Square Kilometre Array will detect tens of millions of these events each night. We employ computers and artificial intelligence to deal with these massive numbers of detections.

However, the majority of these events are faint bursts, and computers are only so good at finding them. A computer can pick out a faint burst if it’s given a template of the “desired” signal. But if signals depart from this expected behaviour, they become lost.

And it’s often these very events that are the most interesting and yield the biggest insight into the nature of the universe. Using data sonification to verify these signals and identify outliers can be powerful.

More than meets the eye

Data sonification is useful for interpreting science because humans interpret audio information faster than visual information. Also, the ear can discern more pitch levels than the eye can discern levels of colour (and over a wider range).

Another direction we’re exploring for data sonification is multi-dimensional data analysis – which involves understanding the relationships between many different features or properties in sound.

Plotting data in ten or more dimensions simultaneously is too complex, and interpreting it is too confusing. However, the same data can be comprehended much more easily through sonification.

As it turns out, the human ear can tell the difference between the sound of a trumpet and flute immediately, even if they play the same note (frequency) at the same loudness and duration.

Why? Because each sound includes higher-order harmonics that help determine the sound quality, or timbre. The different strengths of the higher-order harmonics enable the listener to quickly identify the instrument.

Now imagine placing information – different properties of data – as different strengths of higher-order harmonics. Each object studied would have a unique tone, or belong to a class of tones, depending on its overall properties.

With a bit of training, a person could almost instantly hear and recognise[5] all of the object’s properties, or its classification, from a single tone.

Beyond research

Sonification also has great uses in education (Sonokids[6]) and outreach (for example, SYSTEM Sounds[7] and STRAUSS[8]), and has widespread applications in areas including medicine, finance and more.

But perhaps its greatest power is to enable blind and visually impaired communities to understand images and plots to help with everyday life.

A close-up photo of a green walk signal on a traffic light.
The ‘ticking’ noise that plays with the walk signal at traffic lights is one example of how sonification can assist blind and visually impaired people. Shutterstock

It can also enable meaningful scientific research, and do so quantitatively, as sonification research tools[9] provide numerical values on command.

This capability can help promote STEM careers among blind and visually impaired people. And in doing so, we can tap into a massive pool of brilliant scientists and critical thinkers who may otherwise not have envisioned a path towards science.

What we need now is government and industry support in developing sonification tools further, to improve access and usability, and to help establish sonification standards.

With the growing number of tools available, and the growing need in research and the community, the future of data sonification sounds bright!

Read more: Digital inequality: why can I enter your building – but your website shows me the door?[10]

References

  1. ^ paper (arxiv.org)
  2. ^ projects (sonification.design)
  3. ^ cocktail party effect (www.audiology.org)
  4. ^ A brief history: what we know so far about fast radio bursts across the universe (theconversation.com)
  5. ^ hear and recognise (www.cambridge.org)
  6. ^ Sonokids (www.sonokids.org)
  7. ^ SYSTEM Sounds (www.system-sounds.com)
  8. ^ STRAUSS (www.audiouniverse.org)
  9. ^ sonification research tools (www.jeffreyhannam.com)
  10. ^ Digital inequality: why can I enter your building – but your website shows me the door? (theconversation.com)

Read more https://theconversation.com/scientists-are-turning-data-into-sound-to-listen-to-the-whispers-of-the-universe-and-more-188699

Times Magazine

Building a Strong Online Presence with Katoomba Web Design

Katoomba web design is more than just creating a website that looks good—it’s about building an online presence that reflects your brand, engages your audience, and drives results. For local businesses in the Blue Mountains, a well-designed website a...

September Sunset Polo

International Polo Tour To Bridge Historic Sport, Life-Changing Philanthropy, and Breath-Taking Beauty On Saturday, September 6th, history will be made as the International Polo Tour (IPT), a sports leader headquartered here in South Florida...

5 Ways Microsoft Fabric Simplifies Your Data Analytics Workflow

In today's data-driven world, businesses are constantly seeking ways to streamline their data analytics processes. The sheer volume and complexity of data can be overwhelming, often leading to bottlenecks and inefficiencies. Enter the innovative da...

7 Questions to Ask Before You Sign IT Support Companies in Sydney

Choosing an IT partner can feel like buying an insurance policy you hope you never need. The right choice keeps your team productive, your data safe, and your budget predictable. The wrong choice shows up as slow tickets, surprise bills, and risky sh...

Choosing the Right Legal Aid Lawyer in Sutherland Shire: Key Considerations

Legal aid services play an essential role in ensuring access to justice for all. For people in the Sutherland Shire who may not have the financial means to pay for private legal assistance, legal aid ensures that everyone has access to representa...

Watercolor vs. Oil vs. Digital: Which Medium Fits Your Pet's Personality?

When it comes to immortalizing your pet’s unique personality in art, choosing the right medium is essential. Each artistic medium, whether watercolor, oil, or digital, has distinct qualities that can bring out the spirit of your furry friend in dif...

The Times Features

How much money do you need to be happy? Here’s what the research says

Over the next decade, Elon Musk could become the world’s first trillionaire[1]. The Tesla board recently proposed a US$1 trillion (A$1.5 trillion) compensation plan, if Musk ca...

NSW has a new fashion sector strategy – but a sustainable industry needs a federally legislated response

The New South Wales government recently announced the launch of the NSW Fashion Sector Strategy, 2025–28[1]. The strategy, developed in partnership with the Australian Fashion ...

From Garden to Gift: Why Roses Make the Perfect Present

Think back to the last time you gave or received flowers. Chances are, roses were part of the bunch, or maybe they were the whole bunch.   Roses tend to leave an impression. Even ...

Do I have insomnia? 5 reasons why you might not

Even a single night of sleep trouble can feel distressing and lonely. You toss and turn, stare at the ceiling, and wonder how you’ll cope tomorrow. No wonder many people star...

Wedding Photography Trends You Need to Know (Before You Regret Your Album)

Your wedding album should be a timeless keepsake, not something you cringe at years later. Trends may come and go, but choosing the right wedding photography approach ensures your ...

Can you say no to your doctor using an AI scribe?

Doctors’ offices were once private. But increasingly, artificial intelligence (AI) scribes (also known as digital scribes) are listening in. These tools can record and trans...