The Times Australia
The Times World News

.

using it wisely means knowing its true nature – and our own minds

  • Written by Randolph Grace, Professor of Psychology, University of Canterbury

Future historians may well regard 2023 as a landmark in the advent of artificial intelligence (AI). But whether that future will prove utopian[1], apocalyptic[2] or somewhere in between[3] is anyone’s guess.

In February, ChatGPT set the record as the fastest app to reach 100 million users[4]. It was followed by similar “large language” AI models from Google, Amazon, Meta and other big tech firms, which collectively look poised to transform education, healthcare and many other knowledge-intensive fields.

However, AI’s potential for harm was underscored in May by an ominous statement[5] signed by leading researchers:

Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.

In November, responding to the growing concern about AI risk, 27 nations (including the UK, US, India, China and the European Union) pledged cooperation at an inaugural AI Safety Summit at Bletchley Park in England, to ensure the safe development of AI for the benefit of all[6].

To achieve this, researchers focus on AI alignment[7] – that is, how to make sure AI models are consistent with human values, preferences and goals. But there’s a problem – AI’s so-called “dark secret[8]”: large-scale models are so complex they are like a black box, impossible for anyone to fully understand.

President of the European Commission Ursula von der Leyen arrives at the AI safety summit at Bletchley Park, England, November 2023. Getty Images

AI’s black box problem

Although the transparency and explainability of AI systems are important research goals[9], such efforts seem unlikely to keep up with the frenetic pace of innovation.

The black box metaphor explains why people’s beliefs about AI are all over the map. Predictions range from utopia to extinction, and many even believe an artificial general intelligence (AGI) will soon achieve sentience[10].

Read more: A year of ChatGPT: 5 ways the AI marvel has changed the world[11]

But this uncertainty compounds the problem. AI alignment should be a two-way street: we must not only ensure AI models are consistent with human intentions, but also that our beliefs about AI are accurate.

This is because we are remarkably adept at creating futures that accord with those beliefs, even if we are unaware of them.

So-called “expectancy effects[12]”, or self-fulfilling prophecies, are well known in psychology. And research has shown that manipulating users’ beliefs influences not just how they interact with AI[13], but how AI adapts to the user[14].

In other words, how our beliefs (conscious or unconscious) affect AI can potentially increase the likelihood of any outcome, including catastrophic ones.

Read more: How AI 'sees' the world – what happened when we trained a deep learning model to identify poverty[15]

AI, computation, logic and arithmetic

We need to probe more deeply to understand the basis of AI – like Alice in Wonderland, head down the rabbit hole and see where it takes us.

Firstly, what is AI? It runs on computers, and so is automated computation. From its origin as the “perceptron[16]” – an artificial neuron defined mathematically in 1943 by neurophysiologist Warren McCulloch[17] and logician Walter Pitts[18] – AI has been intertwined with the cognitive sciences, neuroscience and computer science.

This convergence of minds[19], brains[20] and machines[21] has led to the widely-held belief that, because AI is computation by machine, then natural intelligence (the mind) must be computation by the brain.

Alan Turing. Getty Images

But what is computation? In the late 19th century, mathematicians Richard Dedekind[22] and Giuseppe Peano[23] proposed a set of axioms which defined arithmetic in terms of logic[24], and inspired attempts to ground all mathematics on a secure formal basis[25].

Although the logician Kurt Gödel[26] later proved this goal was unachievable[27], his work was the starting point for mathematician (and code-breaker) Alan Turing[28]. His “Turing machine[29]”, an abstract device capable of universal computation[30], is the foundation of computer science.

Read more: Forget dystopian scenarios – AI is pervasive today, and the risks are often hidden[31]

Deep structure of perception

So, computation is based on mathematical ideas that trace back to efforts to define arithmetic in logic. But our knowledge of arithmetic exists prior to logic[32]. If we want to understand the basis of AI, we need to go further and ask where arithmetic itself comes from.

My colleagues and I have recently shown that arithmetic is based on the “deep structure[33]” of perception. This structure is like coloured glasses that shape our perception in particular ways, so that our experience of the world is ordered and manageable.

Arithmetic consists of a set of elements (numbers) and operations (addition, multiplication) that combine pairs of elements to give another element. We asked: of all possibilities, why are numbers the elements, and addition and multiplication the operations?

Read more: Arithmetic has a biological origin – it's an expression in symbols of the 'deep structure' of our perception[34]

We showed by mathematical proof[35] that when the deep structure of perception was assumed to limit the possibilities, arithmetic was the result. In other words, when our mind views the abstract world through the same “coloured glasses” that shape our experience of the physical world, it “sees” numbers and arithmetic.

Because arithmetic is the foundation for mathematics, the implication is that mathematics is a reflection of the mind – an expression in symbols of its fundamental nature and creativity.

Although the deep structure of perception is shared with other animals and so a product of evolution, only humans have invented mathematics. It is our most intimate creation – and by enabling the development of AI, perhaps our most consequential.

Mathematics is a reflection of the mind – an expression in symbols of its fundamental nature and creativity. Getty Images

A Copernican revolution of the mind

Our account of arithmetic’s origin[36] is consistent with views of the 18th century philosopher Immanuel Kant. According to him, our knowledge of the world is structured by “pure intuitions” of space and time that exist prior to sense experience – analogous to the coloured glasses we can never remove.

Kant claimed his philosophy[37] was a “Copernican revolution of the mind”. In the same way ancient astronomers believed the Sun revolved around the Earth because they were unaware of the Earth’s motion, Kant argued, philosophers who believed all knowledge is derived from sense experience[38] (John Locke and David Hume, for example) overlooked how the mind shapes perception.

Read more: AI is closer than ever to passing the Turing test for ‘intelligence’. What happens when it does?[39]

Although Kant’s views were shaped by the natural sciences of his day[40], they have proved influential in contemporary psychology[41].

The recognition that arithmetic is a natural consequence of our perception[42], and thus biologically based, suggests a similar Kantian shift in our understanding of computation.

Computation is not “outside” or separate from us in an abstract realm of mathematical truth, but inherent in our mind’s nature. The mind is more than computation; the brain is not a computer. Rather, computation – the basis for AI – is, like mathematics, a symbolic expression of the mind’s nature and creativity.

Read more: 'Computer says no’: more employers are using AI to recruit, increasing the risk of discrimination[43]

Promethean fire

What are the implications for AI? Firstly, AI is not a mind and will never become sentient. The idea we can transcend our biological nature and achieve immortality by uploading our minds to the cloud is only fantasy[44].

Yet if the principles of mind on which AI is based are shared by all humanity (and likely other living creatures as well), it may be possible to transcend the limitations of our individual minds.

Because computation is universal, we are free to simulate and create any outcome we choose in our increasingly connected virtual and physical worlds. In this way, AI is truly our Promethean fire[45], a gift to humanity stolen from the gods as in Greek mythology[46].

As a global civilisation, we are likely at a turning point. AI will not become sentient and decide to kill us all[47]. But we are very capable of “apocalypsing” ourselves with it – expectation can create reality.

Efforts to ensure AI alignment, safety and security are vitally important, but may not be enough if we lack awareness and collective wisdom. Like Alice, we need to wake up from the dream and recognise the reality and power of our minds.

References

  1. ^ utopian (a16z.com)
  2. ^ apocalyptic (www.toolify.ai)
  3. ^ somewhere in between (www.mckinsey.com)
  4. ^ 100 million users (www.reuters.com)
  5. ^ ominous statement (www.safe.ai)
  6. ^ benefit of all (www.gov.uk)
  7. ^ AI alignment (en.wikipedia.org)
  8. ^ dark secret (www.technologyreview.com)
  9. ^ important research goals (www.sciencedirect.com)
  10. ^ achieve sentience (www.science.org)
  11. ^ A year of ChatGPT: 5 ways the AI marvel has changed the world (theconversation.com)
  12. ^ expectancy effects (journals.sagepub.com)
  13. ^ interact with AI (dl.acm.org)
  14. ^ adapts to the user (dspace.mit.edu)
  15. ^ How AI 'sees' the world – what happened when we trained a deep learning model to identify poverty (theconversation.com)
  16. ^ perceptron (idp.springer.com)
  17. ^ Warren McCulloch (en.wikipedia.org)
  18. ^ Walter Pitts (en.wikipedia.org)
  19. ^ minds (www.cs.cmu.edu)
  20. ^ brains (www.cell.com)
  21. ^ machines (www.nature.com)
  22. ^ Richard Dedekind (en.wikipedia.org)
  23. ^ Giuseppe Peano (en.wikipedia.org)
  24. ^ defined arithmetic in terms of logic (en.wikipedia.org)
  25. ^ formal basis (en.wikipedia.org)
  26. ^ Kurt Gödel (en.wikipedia.org)
  27. ^ unachievable (en.wikipedia.org)
  28. ^ Alan Turing (en.wikipedia.org)
  29. ^ Turing machine (en.wikipedia.org)
  30. ^ universal computation (en.wikipedia.org)
  31. ^ Forget dystopian scenarios – AI is pervasive today, and the risks are often hidden (theconversation.com)
  32. ^ prior to logic (academic.oup.com)
  33. ^ deep structure (theconversation.com)
  34. ^ Arithmetic has a biological origin – it's an expression in symbols of the 'deep structure' of our perception (theconversation.com)
  35. ^ mathematical proof (psycnet.apa.org)
  36. ^ arithmetic’s origin (theconversation.com)
  37. ^ philosophy (plato.stanford.edu)
  38. ^ sense experience (en.wikipedia.org)
  39. ^ AI is closer than ever to passing the Turing test for ‘intelligence’. What happens when it does? (theconversation.com)
  40. ^ natural sciences of his day (books.google.com)
  41. ^ influential in contemporary psychology (www.cell.com)
  42. ^ natural consequence of our perception (theconversation.com)
  43. ^ 'Computer says no’: more employers are using AI to recruit, increasing the risk of discrimination (theconversation.com)
  44. ^ fantasy (medium.com)
  45. ^ Promethean fire (www.japantimes.co.jp)
  46. ^ Greek mythology (en.wikipedia.org)
  47. ^ kill us all (newatlas.com)

Read more https://theconversation.com/ai-is-our-promethean-fire-using-it-wisely-means-knowing-its-true-nature-and-our-own-minds-219320

Times Magazine

Headless CMS in Digital Twins and 3D Product Experiences

Image by freepik As the metaverse becomes more advanced and accessible, it's clear that multiple sectors will use digital twins and 3D product experiences to visualize, connect, and streamline efforts better. A digital twin is a virtual replica of ...

The Decline of Hyper-Casual: How Mid-Core Mobile Games Took Over in 2025

In recent years, the mobile gaming landscape has undergone a significant transformation, with mid-core mobile games emerging as the dominant force in app stores by 2025. This shift is underpinned by changing user habits and evolving monetization tr...

Understanding ITIL 4 and PRINCE2 Project Management Synergy

Key Highlights ITIL 4 focuses on IT service management, emphasising continual improvement and value creation through modern digital transformation approaches. PRINCE2 project management supports systematic planning and execution of projects wit...

What AI Adoption Means for the Future of Workplace Risk Management

Image by freepik As industrial operations become more complex and fast-paced, the risks faced by workers and employers alike continue to grow. Traditional safety models—reliant on manual oversight, reactive investigations, and standardised checklist...

From Beach Bops to Alpine Anthems: Your Sonos Survival Guide for a Long Weekend Escape

Alright, fellow adventurers and relaxation enthusiasts! So, you've packed your bags, charged your devices, and mentally prepared for that glorious King's Birthday long weekend. But hold on, are you really ready? Because a true long weekend warrior kn...

Effective Commercial Pest Control Solutions for a Safer Workplace

Keeping a workplace clean, safe, and free from pests is essential for maintaining productivity, protecting employee health, and upholding a company's reputation. Pests pose health risks, can cause structural damage, and can lead to serious legal an...

The Times Features

Prefab’s Second Life: Why Australia’s Backyard Boom Needs a Circular Makeover

The humble granny flat is being reimagined not just as a fix for housing shortages, but as a cornerstone of circular, factory-built architecture. But are our systems ready to s...

Melbourne’s Burglary Boom: Break-Ins Surge Nearly 25%

Victorian homeowners are being warned to act now, as rising break-ins and falling arrest rates paint a worrying picture for suburban safety. Melbourne residents are facing an ...

Exploring the Curriculum at a Modern Junior School in Melbourne

Key Highlights The curriculum at junior schools emphasises whole-person development, catering to children’s physical, emotional, and intellectual needs. It ensures early year...

Distressed by all the bad news? Here’s how to stay informed but still look after yourself

If you’re feeling like the news is particularly bad at the moment, you’re not alone. But many of us can’t look away – and don’t want to. Engaging with news can help us make ...

The Role of Your GP in Creating a Chronic Disease Management Plan That Works

Living with a long-term condition, whether that is diabetes, asthma, arthritis or heart disease, means making hundreds of small decisions every day. You plan your diet against m...

Troubleshooting Flickering Lights: A Comprehensive Guide for Homeowners

Image by rawpixel.com on Freepik Effectively addressing flickering lights in your home is more than just a matter of convenience; it's a pivotal aspect of both home safety and en...