The Times Australia
The Times World News

.

I used to work at Google and now I'm an AI researcher. Here's why slowing down AI development is wise

  • Written by Rodolfo Ocampo, PhD student, Human–AI Creative Collaboration, UNSW Sydney
I used to work at Google and now I'm an AI researcher. Here's why slowing down AI development is wise

Is it time to put the brakes on the development of artificial intelligence (AI)? If you’ve quietly asked yourself that question, you’re not alone.

In the past week, a host of AI luminaries signed an open letter[1] calling for a six-month pause on the development of more powerful models than GPT-4[2]; European researchers called[3] for tighter AI regulations; and long-time AI researcher and critic Eliezer Yudkowsky demanded a complete shutdown of AI development[4] in the pages of TIME magazine.

Meanwhile, the industry shows no sign of slowing down. In March, a senior AI executive at Microsoft reportedly[5] spoke of “very, very high” pressure from chief executive Satya Nadella to get GPT-4 and other new models to the public “at a very high speed”.

I worked at Google until 2020, when I left to study responsible AI development, and now I research human-AI creative collaboration. I am excited about the potential of artificial intelligence, and I believe it is already ushering in a new era of creativity. However, I believe a temporary pause in the development of more powerful AI systems is a good idea. Let me explain why.

What is GPT-4 and what is the letter asking for?

The open letter published by the US non-profit Future of Life Institute[6] makes a straightforward request of AI developers:

We call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.

So what is GPT-4? Like its predecessor GPT-3.5 (which powers the popular ChatGPT chatbot), GPT-4 is a kind of generative AI software called a “large language model”, developed by OpenAI.

Read more: Evolution not revolution: why GPT-4 is notable, but not groundbreaking[7]

GPT-4 is much larger and has been trained on significantly more data. Like other large language models, GPT-4 works by guessing the next word in response to prompts – but it is nonetheless incredibly capable.

In tests, it passed legal and medical exams, and can write software better than professionals in many cases. And its full range of abilities is yet to be discovered[8].

Good, bad, and plain disruptive

GPT-4 and models like it are likely to have huge effects across many layers of society.

On the upside, they could enhance human creativity and scientific discovery, lower barriers to learning, and be used in personalised educational tools[9]. On the downside, they could facilitate personalised phishing attacks, produce disinformation at scale, and be used to hack through the network security around computer systems that control vital infrastructure[10].

OpenAI’s own research[11] suggests models like GPT-4 are “general-purpose technologies” which will impact some 80% of the US workforce.

Layers of civilisation and the pace of change

The US writer Stewart Brand has argued[12] that a “healthy civilisation” requires different systems or layers to move at different speeds:

The fast layers innovate; the slow layers stabilise. The whole combines learning with continuity.

According to the ‘pace layers’ model, different layers of a healthy civilisation move at different speeds, from the slow movement of nature to the rapid shifts of fashion. Stewart Brand / Journal of Design and Science[13]

In Brand’s “pace layers” model, the bottom layers change more slowly than the top layers.

Technology is usually placed near the top, somewhere between fashion and commerce. Things like regulation, economic systems, security guardrails, ethical frameworks, and other aspects exist in the slower governance, infrastructure and culture layers.

Right now, technology is accelerating much faster than our capacity to understand and regulate it – and if we’re not careful it will also drive changes in those lower layers that are too fast for safety.

The US sociobiologist E.O. Wilson described[14] the dangers of a mismatch in the different paces of change like so:

The real problem of humanity is the following: we have Paleolithic emotions, medieval institutions, and god-like technology.

Are there good reasons to maintain the current rapid pace?

Some argue that if top AI labs slow down, other unaligned players or countries like China will outpace them.

However, training complex AI systems is not easy. OpenAI is ahead of its US competitors (including Google and Meta), and developers in China and other countries also lag behind.

It’s unlikely that “rogue groups” or governments will surpass GPT-4’s capabilities in the foreseeable future. Most AI talent, knowledge, and computing infrastructure is concentrated[15] in a handful of top labs.

Read more: AI chatbots with Chinese characteristics: why Baidu's ChatGPT rival may never measure up[16]

Other critics[17] of the Future of Life Institute letter say it relies on an overblown perception of current and future AI capabilities.

However, whether or not you believe AI will reach a state of general superintelligence, it is undeniable that this technology will impact many facets of human society. Taking the time to let our systems adjust to the pace of change seems wise.

Slowing down is wise

While there is plenty of room for disagreement over specific details, I believe the Future of Life Institute letter points in a wise direction: to take ownership of the pace of technological change.

Despite what we have seen of the disruption caused by social media, Silicon Valley still tends to follow Facebook’s infamous motto of “move fast and break things[18]”.

Read more: Has GPT-4 really passed the startling threshold of human-level artificial intelligence? Well, it depends[19]

I believe a wise course of action is to slow down and think about where we want to take these technologies, allowing our systems and ourselves to adjust and engage in diverse, thoughtful conversations. It is not about stopping, but rather moving at a sustainable pace of progress. We can choose to steer this technology, rather than assume it has a life of its own that we can’t control.

After some thought, I have added my name to the list of signatories of the open letter, which the Future of Life Institute says now includes some 50,000 people. Although a six-month moratorium won’t solve everything, it would be useful: it sets the right intention, to prioritise reflection on benefits and risks over uncritical, accelerated, profit-motivated progress.

References

  1. ^ open letter (futureoflife.org)
  2. ^ GPT-4 (openai.com)
  3. ^ called (www.law.kuleuven.be)
  4. ^ a complete shutdown of AI development (time.com)
  5. ^ reportedly (www.platformer.news)
  6. ^ Future of Life Institute (futureoflife.org)
  7. ^ Evolution not revolution: why GPT-4 is notable, but not groundbreaking (theconversation.com)
  8. ^ yet to be discovered (openai.com)
  9. ^ personalised educational tools (www.youtube.com)
  10. ^ vital infrastructure (www.youtube.com)
  11. ^ own research (arxiv.org)
  12. ^ argued (jods.mitpress.mit.edu)
  13. ^ Stewart Brand / Journal of Design and Science (jods.mitpress.mit.edu)
  14. ^ described (www.oxfordreference.com)
  15. ^ concentrated (www.washingtonpost.com)
  16. ^ AI chatbots with Chinese characteristics: why Baidu's ChatGPT rival may never measure up (theconversation.com)
  17. ^ Other critics (www.dair-institute.org)
  18. ^ move fast and break things (www.businessinsider.com)
  19. ^ Has GPT-4 really passed the startling threshold of human-level artificial intelligence? Well, it depends (theconversation.com)

Read more https://theconversation.com/i-used-to-work-at-google-and-now-im-an-ai-researcher-heres-why-slowing-down-ai-development-is-wise-202944

Times Magazine

Headless CMS in Digital Twins and 3D Product Experiences

Image by freepik As the metaverse becomes more advanced and accessible, it's clear that multiple sectors will use digital twins and 3D product experiences to visualize, connect, and streamline efforts better. A digital twin is a virtual replica of ...

The Decline of Hyper-Casual: How Mid-Core Mobile Games Took Over in 2025

In recent years, the mobile gaming landscape has undergone a significant transformation, with mid-core mobile games emerging as the dominant force in app stores by 2025. This shift is underpinned by changing user habits and evolving monetization tr...

Understanding ITIL 4 and PRINCE2 Project Management Synergy

Key Highlights ITIL 4 focuses on IT service management, emphasising continual improvement and value creation through modern digital transformation approaches. PRINCE2 project management supports systematic planning and execution of projects wit...

What AI Adoption Means for the Future of Workplace Risk Management

Image by freepik As industrial operations become more complex and fast-paced, the risks faced by workers and employers alike continue to grow. Traditional safety models—reliant on manual oversight, reactive investigations, and standardised checklist...

From Beach Bops to Alpine Anthems: Your Sonos Survival Guide for a Long Weekend Escape

Alright, fellow adventurers and relaxation enthusiasts! So, you've packed your bags, charged your devices, and mentally prepared for that glorious King's Birthday long weekend. But hold on, are you really ready? Because a true long weekend warrior kn...

Effective Commercial Pest Control Solutions for a Safer Workplace

Keeping a workplace clean, safe, and free from pests is essential for maintaining productivity, protecting employee health, and upholding a company's reputation. Pests pose health risks, can cause structural damage, and can lead to serious legal an...

The Times Features

Tricia Paoluccio designer to the stars

The Case for Nuturing Creativity in the Classroom, and in our Lives I am an actress and an artist who has had the privilege of sharing my work across many countries, touring my ...

Duke of Dural to Get Rooftop Bar as New Owners Invest in Venue Upgrade

The Duke of Dural, in Sydney’s north-west, is set for a major uplift under new ownership, following its acquisition by hospitality group Good Beer Company this week. Led by resp...

Prefab’s Second Life: Why Australia’s Backyard Boom Needs a Circular Makeover

The humble granny flat is being reimagined not just as a fix for housing shortages, but as a cornerstone of circular, factory-built architecture. But are our systems ready to s...

Melbourne’s Burglary Boom: Break-Ins Surge Nearly 25%

Victorian homeowners are being warned to act now, as rising break-ins and falling arrest rates paint a worrying picture for suburban safety. Melbourne residents are facing an ...

Exploring the Curriculum at a Modern Junior School in Melbourne

Key Highlights The curriculum at junior schools emphasises whole-person development, catering to children’s physical, emotional, and intellectual needs. It ensures early year...

Distressed by all the bad news? Here’s how to stay informed but still look after yourself

If you’re feeling like the news is particularly bad at the moment, you’re not alone. But many of us can’t look away – and don’t want to. Engaging with news can help us make ...