The Times Australia
The Times World News

.

How America’s war on ‘ideological bias’ is letting AI off the leash

  • Written by Judith Bishop, Tracey Banivanua Mar Fellow, La Trobe University

Badly behaved artificial intelligence (AI) systems have a long history in science fiction. Way back in 1961, in the famous Astro Boy comics by Osamu Tezuka, a clone of a popular robot magician[1] was reprogrammed into a super-powered thief. In the 1968 film 2001: A Space Odyssey, the shipboard computer HAL 9000[2] turns out to be more sinister than the astronauts on board think.

More recently, real-world chatbots such as Microsoft’s Tay[3] have shown that AI models “going bad” isn’t sci-fi any longer. Tay started spewing racist and sexually explicit texts within hours of its public release in 2016.

The generative AI models we’ve been using since ChatGPT launched in November 2022 are generally well behaved. There are signs this may be about to change.

On February 20, the US Federal Trade Commission announced an inquiry[4] to understand “how consumers have been harmed […] by technology platforms that limit users’ ability to share their ideas or affiliations freely and openly”. Introducing the inquiry[5], the commission said platforms with internal processes to suppress unsafe content “may have violated the law”.

The latest version of the Elon Musk–owned Grok model already serves up “based[6]” opinions, and features an “unhinged mode[7]” that is “intended to be objectionable, inappropriate, and offensive”. Recent ChatGPT updates allow the bot to produce “erotica and gore[8]”.

These developments come after moves by US President Donald Trump to deregulate AI systems. Trump’s attempt to remove “ideological bias” from AI[9] may see the return of rogue behaviour that AI developers have been working hard to suppress.

Executive orders

In January, Trump issued a sweeping executive order[10] against “illegal and immoral discrimination programs, going by the name ‘diversity, equity, and inclusion’ (DEI)”, and another[11] on “removing barriers to AI innovation” (which includes “engineered social agendas”).

In February, the US refused[12] to join 62 other nations in signing a “Statement on Inclusive and Sustainable AI” at the Paris AI Action Summit.

Photo of four men and one woman standing in a line.
Tech tycoons including Mark Zuckerberg, Jeff Bezos, Sundar Pichai and Elon Musk (pictured here at Donald Trump’s inauguration) have been prominent supporters of the Trump administration. Julia Demaree Nikhinson / AP

What will this mean for the AI products we see around us? Some generative AI companies, including Microsoft and Google[13], are US federal government suppliers. These companies could come under significant direct pressure to eliminate measures to make AI systems safe, if the measures are perceived as supporting DEI or slowing innovation.

AI developers’ interpretation of the executive orders could result in AI safety teams being reduced in size or scope, or replaced by teams whose social agenda better aligns with Trump’s.

Why would that matter? Before generative AI algorithms are trained, they are neither helpful nor harmful. However, when they are fed a diet of human expression scraped from across the internet, their propensity to reflect biases and behaviours such as racism[14], sexism[15], ableism[16] and abusive language becomes clear.

AI risks and how they’re managed

Major AI developers spend a lot of effort on suppressing biased outputs and unwanted model behaviours and rewarding more ethically neutral and balanced responses.

Some of these measures could be seen as implementing DEI principles, even as they help to avoid incidents like the one involving Tay. They include the use of human feedback to tune model outputs[17], as well as monitoring and measuring bias towards specific populations.

Another approach, developed by Anthropic for its Claude model, uses a policy document called a “constitution”[18] to explicitly direct the model to respect principles of harmless and respectful behaviour.

Model outputs are often tested via “red teaming”. In this process, prompt engineers and internal AI safety experts do their best to provoke unsafe and offensive responses from generative AI models.

A Microsoft blog post[19] from January described red teaming as “the first step in identifying potential harms […] to measure, manage, and govern AI risks for our customers”.

The risks span a “wide range of vulnerabilities”, “including traditional security, responsible AI, and psychosocial harms”.

The blog also notes “it is crucial to design red teaming probes that not only account for linguistic differences but also redefine harms in different political and cultural contexts”. Many generative AI products have a global user base. So this sort of effort is important for making the products safe for consumers and businesses well beyond US borders.

We may be about to relearn some lessons

Unfortunately, none of these efforts to make generative AI models safe is a one-shot process. Once generative AI models are installed in chatbots or other apps, they continually digest information from the human world through prompts and other inputs.

This diet can shift their behaviour for the worse over time. Malicious attacks, such as user prompt injection[20] and data poisoning[21], can produce more dramatic changes.

Tech journalist Kevin Roose used prompt injection to make Microsoft Bing’s AI chatbot reveal its “shadow self”[22]. The upshot? It encouraged him to leave his wife. Research published last month[23] showed that a mere drop of poisoned data could make medical advice models generate misinformation.

Constant monitoring and correction of AI outputs are essential. There is no other way to avoid offensive, discriminatory or unsafe behaviours cropping up without warning in generated responses.

Yet all signs suggest the Trump administration favours a reduction in the ethical regulation of AI. The executive orders may be interpreted as allowing or encouraging the free expression and generation of even discriminatory and harmful views on subjects such as women, race, LGBTQIA+ individuals and immigrants.

Generative AI moderation efforts may go the way of Meta’s fact-checking and expert content moderation programs[24]. This could have an impact on global users of US-made AI products such as OpenAI ChatGPT, Microsoft Co-Pilot and Google Gemini.

We might be about to rediscover how essential these efforts have been to keep AI models in check.

References

  1. ^ a popular robot magician (tezukainenglish.com)
  2. ^ HAL 9000 (en.wikipedia.org)
  3. ^ Microsoft’s Tay (arstechnica.com)
  4. ^ an inquiry (www.ftc.gov)
  5. ^ Introducing the inquiry (www.ftc.gov)
  6. ^ based (arstechnica.com)
  7. ^ unhinged mode (decrypt.co)
  8. ^ erotica and gore (arstechnica.com)
  9. ^ remove “ideological bias” from AI (www.whitehouse.gov)
  10. ^ executive order (www.whitehouse.gov)
  11. ^ another (www.whitehouse.gov)
  12. ^ refused (www.bbc.com)
  13. ^ Microsoft and Google (www.axios.com)
  14. ^ racism (www.pnas.org)
  15. ^ sexism (dl.acm.org)
  16. ^ ableism (aclanthology.org)
  17. ^ use of human feedback to tune model outputs (cloud.google.com)
  18. ^ policy document called a “constitution” (www.anthropic.com)
  19. ^ blog post (www.microsoft.com)
  20. ^ user prompt injection (www.ibm.com)
  21. ^ data poisoning (www.ibm.com)
  22. ^ reveal its “shadow self” (www.nytimes.com)
  23. ^ Research published last month (www.nature.com)
  24. ^ Meta’s fact-checking and expert content moderation programs (theconversation.com)

Read more https://theconversation.com/erotica-gore-and-racism-how-americas-war-on-ideological-bias-is-letting-ai-off-the-leash-250060

Times Magazine

Choosing the Right Legal Aid Lawyer in Sutherland Shire: Key Considerations

Legal aid services play an essential role in ensuring access to justice for all. For people in the Sutherland Shire who may not have the financial means to pay for private legal assistance, legal aid ensures that everyone has access to representa...

Watercolor vs. Oil vs. Digital: Which Medium Fits Your Pet's Personality?

When it comes to immortalizing your pet’s unique personality in art, choosing the right medium is essential. Each artistic medium, whether watercolor, oil, or digital, has distinct qualities that can bring out the spirit of your furry friend in dif...

DIY Is In: How Aussie Parents Are Redefining Birthday Parties

When planning his daughter’s birthday, Rich opted for a DIY approach, inspired by her love for drawing maps and giving clues. Their weekend tradition of hiding treats at home sparked the idea, and with a pirate ship playground already chosen as t...

When Touchscreens Turn Temperamental: What to Do Before You Panic

When your touchscreen starts acting up, ignoring taps, registering phantom touches, or freezing entirely, it can feel like your entire setup is falling apart. Before you rush to replace the device, it’s worth taking a deep breath and exploring what c...

Why Social Media Marketing Matters for Businesses in Australia

Today social media is a big part of daily life. All over Australia people use Facebook, Instagram, TikTok , LinkedIn and Twitter to stay connected, share updates and find new ideas. For businesses this means a great chance to reach new customers and...

Building an AI-First Culture in Your Company

AI isn't just something to think about anymore - it's becoming part of how we live and work, whether we like it or not. At the office, it definitely helps us move faster. But here's the thing: just using tools like ChatGPT or plugging AI into your wo...

The Times Features

From Farms to Festivals: How Regional NSW Is Repurposing Shipping Containers

Regional NSW communities are repurposing containers for farms, tourism, and events Farmers and small businesses use them as cost-effective, flexible infrastructure Festivals ...

What a Mobile Speech Pathologist Really Does for Late Talkers

As a parent, it’s natural to keep a close eye on your child’s development. When your toddler isn’t using as many words as their peers, the internet can feel like a rabbit hole ...

Benefits of Tree Pruning for a Thriving Australian Garden

Tree pruning is an essential aspect of garden maintenance that often doesn't get the attention it deserves. It's a practice that involves the selective removal of certain parts...

What is psychosocial therapy? And why is the government thinking about adding it to Medicare for kids?

The government is considering new, bulk-billed health checks for three-year-olds, to pick up developmental concerns and refer kids that might need additional support. The de...

Detect Hidden Water Leaks Fast: Don’t Ignore Hot Water System Leaks

Detecting water leaks early is crucial for preventing extensive damage to your home. Among the various parts of a home’s plumbing system, hot water systems are particularly suscept...

Why do hamstring injuries happen so often and how can they be prevented?

In a recent clash against the Melbourne Storm, the Brisbane Broncos endured a nightmare rarely seen in professional sport — three players tore their hamstrings[1] in a single g...