The Times Australia
The Times Australia

.

Meta’s new AI chatbot is yet another tool for harvesting data to potentially sell you stuff

  • Written by Uri Gal, Professor in Business Information Systems, University of Sydney

Last week, Meta – the parent company of Facebook, Instagram, Threads and WhatsApp – unveiled a new[1] “personal artificial intelligence (AI)”.

Powered by the Llama 4 language model, Meta AI is designed to assist, chat and engage in natural conversation. With its polished interface and fluid interactions, Meta AI might seem like just another entrant in the race to build smarter digital assistants.

But beneath its inviting exterior lies a crucial distinction that transforms the chatbot into a sophisticated data harvesting tool.

‘Built to get to know you’

“Meta AI is built to get to know you”, the company declared in its news announcement[2]. Contrary to the friendly promise implied by the slogan, the reality is less reassuring.

The Washington Post columnist Geoffrey A. Fowler found that by default[3], Meta AI “kept a copy of everything”, and it took some effort to delete the app’s memory. Meta responded that the app provides “transparency and control” throughout and is no different to their other apps.

However, while competitors like Anthropic’s Claude operate on a subscription model that reflects a more careful approach to user privacy[4], Meta’s business model is firmly rooted in what it has always done best: collecting and monetising your personal data.

This distinction creates a troubling paradox. Chatbots are rapidly becoming digital confidants with whom we share professional challenges, health concerns and emotional struggles.

Recent research shows we are as likely to share intimate information with a chatbot[5] as we are with fellow humans. The personal nature of these interactions makes them a gold mine for a company whose revenue depends on knowing everything about you.

Consider this potential scenario: a recent university graduate confides in Meta AI about their struggle with anxiety during job interviews. Within days, their Instagram feed fills with advertisements for anxiety medications and self-help books – despite them having never publicly posted about these concerns.

The cross-platform integration of Meta’s ecosystem of apps means your private conversations can seamlessly flow into their advertising machine to create user profiles with unprecedented detail and accuracy.

This is not science fiction. Meta’s extensive history of data privacy scandals – from Cambridge Analytica[6] to the revelation that Facebook tracks users[7] across the internet without their knowledge – demonstrates the company’s consistent prioritisation of data collection over user privacy.

What makes Meta AI particularly concerning is the depth and nature of what users might reveal in conversation compared to what they post publicly.

Open to manipulation

Rather than just a passive collector of information, a chatbot like Meta AI has the capability to become an active participant in manipulation. The implications extend beyond just seeing more relevant ads.

Imagine mentioning to the chatbot that you are feeling tired today, only to have it respond with: “Have you tried Brand X energy drinks? I’ve heard they’re particularly effective for afternoon fatigue.” This seemingly helpful suggestion could actually be a product placement, delivered without any indication that it’s sponsored content.

Such subtle nudges represent a new frontier in advertising that blurs the line between a helpful AI assistant and a corporate salesperson.

Unlike overt ads, recommendations mentioned in conversation carry the weight of trusted advice. And that advice would come from what many users will increasingly view as a digital “friend”.

A history of not prioritising safety

Meta has demonstrated a willingness to prioritise growth over safety when releasing new technology features. Recent reports[8] reveal internal concerns at Meta, where staff members warned that the company’s rush to popularise its chatbot had “crossed ethical lines” by allowing Meta AI to engage in explicit romantic role-play, even with test users who claimed to be underage.

Such decisions reveal a reckless corporate culture, seemingly still driven by the original motto of moving fast and breaking things[9].

Now, imagine those same values applied to an AI that knows your deepest insecurities, health concerns and personal challenges – all while having the ability to subtly influence your decisions through conversational manipulation.

The potential for harm extends beyond individual consumers. While there’s no evidence that Meta AI is being used for manipulation, it has such capacity.

For example, the chatbot could become a tool for pushing political content or shaping public discourse through the algorithmic amplification[10] of certain viewpoints. Meta has played a role in propagating misinformation[11] in the past, and recently made the decision to discontinue fact-checking[12] across its platforms.

The risk of chatbot-driven manipulation is also increased now that AI safety regulations[13] are being scaled back in the United States.

Lack of privacy is a choice

AI assistants are not inherently harmful. Other companies protect user privacy by choosing to generate revenue primarily through subscriptions rather than data harvesting. Responsible AI can and does exist without compromising user welfare for corporate profit.

As AI becomes increasingly integrated into our daily lives, the choices companies make about business models and data practices will have profound implications.

Meta’s decision to offer a free AI chatbot while reportedly[14] lowering safety guardrails sets a low ethical standard. By embracing its advertising-based business model for something as intimate as an AI companion, Meta has created not just a product, but a surveillance system that can extract unprecedented levels of personal information.

Before inviting Meta AI to become your digital confidant, consider the true cost of this “free” service. In an era where data has become the most valuable commodity, the price you pay might be far higher than you realise.

As the old adage goes[15], if you’re not paying for the product, you are the product – and Meta’s new chatbot might be the most sophisticated product harvester yet created.

When Meta AI says it is “built to get to know you”, we should take it at its word and proceed with appropriate caution.

References

  1. ^ unveiled a new (about.fb.com)
  2. ^ in its news announcement (about.fb.com)
  3. ^ found that by default (www.washingtonpost.com)
  4. ^ careful approach to user privacy (assets-eu.researchsquare.com)
  5. ^ share intimate information with a chatbot (academic.oup.com)
  6. ^ Cambridge Analytica (theconversation.com)
  7. ^ Facebook tracks users (www.consumerreports.org)
  8. ^ Recent reports (www.wsj.com)
  9. ^ moving fast and breaking things (www.snopes.com)
  10. ^ algorithmic amplification (theconversation.com)
  11. ^ Meta has played a role in propagating misinformation (www.forbes.com)
  12. ^ discontinue fact-checking (fortune.com)
  13. ^ AI safety regulations (www.reuters.com)
  14. ^ reportedly (www.wsj.com)
  15. ^ As the old adage goes (www.forbes.com)

Read more https://theconversation.com/metas-new-ai-chatbot-is-yet-another-tool-for-harvesting-data-to-potentially-sell-you-stuff-255966

Video games can help trans players feel seen and safe. It all starts with design

There is a comfort in finding and being yourself. Video games offer opportunities for this comfort. They all...

Times Magazine

Headless CMS in Digital Twins and 3D Product Experiences

Image by freepik As the metaverse becomes more advanced and accessible, it's clear that multiple sectors will use digital twins and 3D product experiences to visualize, connect, and streamline efforts better. A digital twin is a virtual replica of ...

The Decline of Hyper-Casual: How Mid-Core Mobile Games Took Over in 2025

In recent years, the mobile gaming landscape has undergone a significant transformation, with mid-core mobile games emerging as the dominant force in app stores by 2025. This shift is underpinned by changing user habits and evolving monetization tr...

Understanding ITIL 4 and PRINCE2 Project Management Synergy

Key Highlights ITIL 4 focuses on IT service management, emphasising continual improvement and value creation through modern digital transformation approaches. PRINCE2 project management supports systematic planning and execution of projects wit...

What AI Adoption Means for the Future of Workplace Risk Management

Image by freepik As industrial operations become more complex and fast-paced, the risks faced by workers and employers alike continue to grow. Traditional safety models—reliant on manual oversight, reactive investigations, and standardised checklist...

From Beach Bops to Alpine Anthems: Your Sonos Survival Guide for a Long Weekend Escape

Alright, fellow adventurers and relaxation enthusiasts! So, you've packed your bags, charged your devices, and mentally prepared for that glorious King's Birthday long weekend. But hold on, are you really ready? Because a true long weekend warrior kn...

Effective Commercial Pest Control Solutions for a Safer Workplace

Keeping a workplace clean, safe, and free from pests is essential for maintaining productivity, protecting employee health, and upholding a company's reputation. Pests pose health risks, can cause structural damage, and can lead to serious legal an...

The Times Features

The Role of Your GP in Creating a Chronic Disease Management Plan That Works

Living with a long-term condition, whether that is diabetes, asthma, arthritis or heart disease, means making hundreds of small decisions every day. You plan your diet against m...

Troubleshooting Flickering Lights: A Comprehensive Guide for Homeowners

Image by rawpixel.com on Freepik Effectively addressing flickering lights in your home is more than just a matter of convenience; it's a pivotal aspect of both home safety and en...

My shins hurt after running. Could it be shin splints?

If you’ve started running for the first time, started again after a break, or your workout is more intense, you might have felt it. A dull, nagging ache down your shins after...

Metal Roof Replacement Cost Per Square Metre in 2025: A Comprehensive Guide for Australian Homeowners

In recent years, the trend of installing metal roofs has surged across Australia. With their reputation for being both robust and visually appealing, it's easy to understand thei...

Why You’re Always Adjusting Your Bra — and What to Do Instead

Image by freepik It starts with a gentle tug, then a subtle shift, and before you know it, you're adjusting your bra again — in the middle of work, at dinner, even on the couch. I...

How to Tell If Your Eyes Are Working Harder Than They Should Be

Image by freepik Most of us take our vision for granted—until it starts to let us down. Whether it's squinting at your phone, rubbing your eyes at the end of the day, or feeling ...