The Times Australia
The Times World News

.

Physics Nobel awarded to neural network pioneers who laid foundations for AI

  • Written by Aaron J. Snoswell, Research Fellow in AI Accountability, Queensland University of Technology
Infographic comparing natural and artificial neurons.

The 2024 Nobel Prize in Physics[1] has been awarded to scientists John Hopfield and Geoffrey Hinton “for foundational discoveries and inventions that enable machine learning with artificial neural networks”.

Inspired by ideas from physics and biology, Hopfield and Hinton developed computer systems that can memorise and learn from patterns in data. Despite never directly collaborating, they built on each other’s work to develop the foundations of the current boom in machine learning and artificial intelligence (AI).

What are neural networks? (And what do they have to do with physics?)

Artificial neural networks are behind much of the AI technology we use today.

In the same way your brain has neuronal cells linked by synapses, artificial neural networks have digital neurons connected in various configurations. Each individual neuron doesn’t do much. Instead, the magic lies in the pattern and strength of the connections between them.

Neurons in an artificial neural network are “activated” by input signals. These activations cascade from one neuron to the next in ways that can transform and process the input information. As a result, the network can carry out computational tasks such as classification, prediction and making decisions.

Infographic comparing natural and artificial neurons.
Johan Jarnestad / The Royal Swedish Academy of Sciences[2] Most of the history of machine learning has been about finding ever more sophisticated ways to form and update these connections between artificial neurons. While the foundational idea of linking together systems of nodes to store and process information came from biology, the mathematics used to form and update these links came from physics. Networks that can remember John Hopfield (born 1933) is a US theoretical physicist who made important contributions over his career in the field of biological physics. However, the Nobel Physics prize was for his work developing Hopfield networks[3] in 1982. Hopfield networks were one of the earliest kinds of artificial neural networks. Inspired by principles from neurobiology and molecular physics, these systems demonstrated for the first time how a computer could use a “network” of nodes to remember and recall information. The networks Hopfield developed could memorise data (such as a collection of black and white images). These images could be “recalled” by association when the network is prompted with a similar image. Although of limited practical use, Hopfield networks demonstrated that this type of ANN could store and retrieve data in new ways. They laid the foundation for later work by Hinton. Infographic showing how a neural network can store information as a kind of 'landscape'. Johan Jarnestad / The Royal Swedish Academy of Sciences[4] Machines that can learn Geoff Hinton (born 1947), sometimes called one of the “godfathers of AI[5]”, is a British-Canadian computer scientist who has made a number of important contributions to the field. In 2018, along with Yoshua Bengio and Yann LeCun, he was awarded the Turing Award (the highest honour in computer science) for his efforts to advance machine learning generally, and specifically a branch of it called deep learning. The Nobel Prize in Physics, however, is specifically for his work with Terrence Sejnowski and other colleagues in 1984, developing Boltzmann machines[6]. These are an extension of the Hopfield network that demonstrated the idea of machine learning – a system that lets a computer learn not from a programmer, but from examples of data. Drawing from ideas in the energy dynamics of statistical physics, Hinton showed how this early generative computer model could learn to store data over time by being shown examples of things to remember. Infographic showing different types of neural network. Johan Jarnestad / The Royal Swedish Academy of Sciences[7] The Boltzmann machine, like the Hopfield network before it, did not have immediate practical applications. However, a modified form (called the restricted Boltzmann machine) was useful in some applied problems. More important was the conceptual breakthrough that an artificial neural network could learn from data. Hinton continued to develop this idea. He later published influential papers on backpropagation[8] (the learning process used in modern machine learning systems) and convolutional neural networks[9] (the main type of neural network used today for AI systems that work with image and video data). Why this prize, now? Hopfield networks and Boltzmann machines seem whimsical compared to today’s feats of AI. Hopfield’s network contained only 30 neurons (he tried to make one with 100 nodes, but it was too much for the computing resources of the time), whereas modern systems such as ChatGPT can have millions. However, today’s Nobel prize underscores just how important these early contributions were to the field. While recent rapid progress in AI – familiar to most of us from generative AI systems such as ChatGPT – might seem like vindication for the early proponents of neural networks, Hinton at least has expressed concern. In 2023, after quitting a decade-long stint at Google’s AI branch, he said he was scared by the rate of development[10] and joined the growing throng of voices calling for more proactive AI regulation. After receiving the Nobel prize, Hinton said[11] AI will be “like the Industrial Revolution but instead of our physical capabilities, it’s going to exceed our intellectual capabilities”. He also said he still worries that the consequences of his work might be “systems that are more intelligent than us that might eventually take control”. References^ 2024 Nobel Prize in Physics (www.nobelprize.org)^ Johan Jarnestad / The Royal Swedish Academy of Sciences (www.nobelprize.org)^ Hopfield networks (www.pnas.org)^ Johan Jarnestad / The Royal Swedish Academy of Sciences (www.nobelprize.org)^ godfathers of AI (www.forbes.com)^ Boltzmann machines (www.cs.toronto.edu)^ Johan Jarnestad / The Royal Swedish Academy of Sciences (www.nobelprize.org)^ backpropagation (www.nature.com)^ convolutional neural networks (dl.acm.org)^ scared by the rate of development (www.nytimes.com)^ said (www.bbc.com)

Read more https://theconversation.com/physics-nobel-awarded-to-neural-network-pioneers-who-laid-foundations-for-ai-240833

Times Magazine

Building a Strong Online Presence with Katoomba Web Design

Katoomba web design is more than just creating a website that looks good—it’s about building an online presence that reflects your brand, engages your audience, and drives results. For local businesses in the Blue Mountains, a well-designed website a...

September Sunset Polo

International Polo Tour To Bridge Historic Sport, Life-Changing Philanthropy, and Breath-Taking Beauty On Saturday, September 6th, history will be made as the International Polo Tour (IPT), a sports leader headquartered here in South Florida...

5 Ways Microsoft Fabric Simplifies Your Data Analytics Workflow

In today's data-driven world, businesses are constantly seeking ways to streamline their data analytics processes. The sheer volume and complexity of data can be overwhelming, often leading to bottlenecks and inefficiencies. Enter the innovative da...

7 Questions to Ask Before You Sign IT Support Companies in Sydney

Choosing an IT partner can feel like buying an insurance policy you hope you never need. The right choice keeps your team productive, your data safe, and your budget predictable. The wrong choice shows up as slow tickets, surprise bills, and risky sh...

Choosing the Right Legal Aid Lawyer in Sutherland Shire: Key Considerations

Legal aid services play an essential role in ensuring access to justice for all. For people in the Sutherland Shire who may not have the financial means to pay for private legal assistance, legal aid ensures that everyone has access to representa...

Watercolor vs. Oil vs. Digital: Which Medium Fits Your Pet's Personality?

When it comes to immortalizing your pet’s unique personality in art, choosing the right medium is essential. Each artistic medium, whether watercolor, oil, or digital, has distinct qualities that can bring out the spirit of your furry friend in dif...

The Times Features

NSW has a new fashion sector strategy – but a sustainable industry needs a federally legislated response

The New South Wales government recently announced the launch of the NSW Fashion Sector Strategy, 2025–28[1]. The strategy, developed in partnership with the Australian Fashion ...

From Garden to Gift: Why Roses Make the Perfect Present

Think back to the last time you gave or received flowers. Chances are, roses were part of the bunch, or maybe they were the whole bunch.   Roses tend to leave an impression. Even ...

Do I have insomnia? 5 reasons why you might not

Even a single night of sleep trouble can feel distressing and lonely. You toss and turn, stare at the ceiling, and wonder how you’ll cope tomorrow. No wonder many people star...

Wedding Photography Trends You Need to Know (Before You Regret Your Album)

Your wedding album should be a timeless keepsake, not something you cringe at years later. Trends may come and go, but choosing the right wedding photography approach ensures your ...

Can you say no to your doctor using an AI scribe?

Doctors’ offices were once private. But increasingly, artificial intelligence (AI) scribes (also known as digital scribes) are listening in. These tools can record and trans...

There’s a new vaccine for pneumococcal disease in Australia. Here’s what to know

The Australian government announced last week there’s a new vaccine[1] for pneumococcal disease on the National Immunisation Program for all children. This vaccine replaces pr...