The Times Australia
The Times World News

.
The Times Real Estate

.

OpenAI’s new ‘deep research’ agent is still just a fallible tool – not a human-level expert

  • Written by Raffaele F Ciriello, Senior Lecturer in Business Information Systems, University of Sydney
OpenAI’s new ‘deep research’ agent is still just a fallible tool – not a human-level expert

OpenAI’s “deep research[1]” is the latest artificial intelligence (AI) tool making waves[2] and promising to do in minutes what would take hours for a human expert to complete.

Bundled as a feature in ChatGPT Pro and marketed[3] as a research assistant that can match a trained analyst, it autonomously searches the web, compiles sources and delivers structured reports. It even scored[4] 26.6% on Humanity’s Last Exam (HLE), a tough AI benchmark, outperforming[5] many models.

But deep research doesn’t quite live up to the hype. While it produces polished reports, it also has serious flaws. According to journalists[6] who’ve tried it[7], deep research can miss key details, struggle with recent information and sometimes invents facts.

OpenAI flags this when listing the limitations of its tool. The company also says it[8] “can sometimes hallucinate facts in responses or make incorrect inferences, though at a notably lower rate than existing ChatGPT models, according to internal evaluations”.

It’s no surprise that unreliable data can slip in, since AI models don’t “know” things in the same way humans do.

The idea of an AI “research analyst” also raises a slew of questions. Can a machine – no matter how powerful – truly replace a trained expert? What would be the implications for knowledge work? And is AI really helping us think better, or just making it easier to stop thinking altogether?

What is ‘deep research’ and who is it for?

Marketed towards professionals in finance, science, policy, law and engineering, as well as academics, journalists and business strategists, deep research is the latest “agentic experience[9]” OpenAI has rolled out in ChatGPT. It promises to do the heavy lifting of research in minutes.

Currently, deep research is only available to ChatGPT Pro users in the United States, at a cost of US$200 per month. OpenAI says[10] it will roll out to Plus, Team and Enterprise users in the coming months, with a more cost-effective version planned for the future.

Unlike a standard chatbot that provides quick responses, deep research follows a multi-step process to produce a structured report:

  1. The user submits a request. This could be anything from a market analysis to a legal case summary.
  2. The AI clarifies the task. It may ask follow-up questions to refine the research scope.
  3. The agent searches the web. It autonomously browses hundreds of sources, including news articles, research papers and online databases.
  4. It synthesises its findings. The AI extracts key points, organises them into a structured report and cites its sources.
  5. The final report is delivered. Within five to 30 minutes, the user receives a multi-page document – potentially even a PhD-level thesis[11] – summarising the findings.

At first glance, it sounds like a dream tool for knowledge workers. A closer look reveals significant limitations.

Many[12] early[13] tests[14] have exposed shortcomings:

  • It lacks context. AI can summarise, but it doesn’t fully understand what’s important.
  • It ignores new developments. It has missed major legal rulings and scientific updates.
  • It makes things up. Like other AI models, it can confidently generate false information.
  • It can’t tell fact from fiction. It doesn’t distinguish authoritative sources from unreliable ones.

While OpenAI claims its tool rivals human analysts, AI inevitably lacks the judgement, scrutiny and expertise that make good research valuable.

What AI can’t replace

ChatGPT isn’t the only AI tool that can scour the web and produce reports with just a few prompts. Notably, a mere 24 hours after OpenAI’s release[15], Hugging Face released a free, open-source version that nearly matches its performance.

The biggest risk of deep research and other AI tools marketed for “human-level” research is the illusion that AI can replace human thinking. AI can summarise information, but it can’t question its own assumptions, highlight knowledge gaps, think creatively or understand different perspectives.

And AI-generated summaries don’t match the depth[16] of a skilled[17] human researcher.

Any AI agent, no matter how fast, is still just a tool, not a replacement for human intelligence. For knowledge workers, it’s more important than ever to invest in skills that AI can’t replicate: critical thinking, fact-checking, deep expertise and creativity.

If you do want to use AI research tools, there are ways to do so responsibly. Thoughtful use of AI can enhance research without sacrificing accuracy or depth. You might use AI for efficiency, like summarising documents, but retain human judgement for making decisions.

Always verify sources, as AI-generated citations can be misleading. Don’t trust conclusions blindly, but apply critical thinking and cross-check information with reputable sources. For high-stakes topics — such as health[18], justice[19] and democracy[20] — supplement AI findings with expert input.

Despite prolific marketing that tries to tell us otherwise, generative AI still has plenty of limitations. Humans who can creatively synthesise information, challenge assumptions and think critically will remain in demand – AI can’t replace them just yet.

References

  1. ^ deep research (openai.com)
  2. ^ making waves (www.forbes.com)
  3. ^ marketed (www.theguardian.com)
  4. ^ scored (www.zdnet.com)
  5. ^ outperforming (www.techradar.com)
  6. ^ According to journalists (www.theverge.com)
  7. ^ who’ve tried it (www.platformer.news)
  8. ^ The company also says it (openai.com)
  9. ^ agentic experience (openai.com)
  10. ^ says (openai.com)
  11. ^ potentially even a PhD-level thesis (futureofbeinghuman.com)
  12. ^ Many (www.theverge.com)
  13. ^ early (www.nature.com)
  14. ^ tests (www.datacamp.com)
  15. ^ 24 hours after OpenAI’s release (arstechnica.com)
  16. ^ depth (futureofbeinghuman.com)
  17. ^ skilled (www.tandfonline.com)
  18. ^ health (www.theguardian.com)
  19. ^ justice (www.theguardian.com)
  20. ^ democracy (www.theguardian.com)

Read more https://theconversation.com/openais-new-deep-research-agent-is-still-just-a-fallible-tool-not-a-human-level-expert-249496

The Times Features

Why You Need an Expert Electrician for Your Business’s Electrical Upgrades and Repairs

When it comes to maintaining and upgrading your business’s electrical systems, it’s essential to call in a professional. Electrical work in any commercial setting requires the ex...

Why Is It Crucial to Have a Building Inspection Done Before Buying a New Home?

Purchasing a new property is a big financial decision that can impact your future for years. Whether you are a first-time buyer or an investor, good or bad, it is essential to en...

Online Application for Sick Leave Certificate: Understanding When and How to Secure One

A sick leave certificate is an official document issued by a healthcare professional to verify an individual's inability to attend work due to illness. It typically includes the ...

Digital mental health programs are inexpensive and innovative. But do they work?

Almost half of Australians will experience[1] mental health problems in their lifetime. Recent floods, droughts, cyclones, bushfires and the COVID pandemic have increased dis...

A No-Fuss Guide to an Effective Beauty Routine

Taking care of the skin and appearance need not be complicated; it need not even consume your hours of time. Smart and simple approaches can give one that glow and fresh look witho...

Safe & Effective Tattoo Removal in Auckland – What You Need to Know

If you're looking for tattoo removal in Auckland, modern laser technology offers the safest and most effective way to fade or completely remove unwanted ink. Whether it's an outd...

Times Magazine

The Ultimate Guide to Apple Watch Faces & Trending Wallpapers

In today’s digital world, personalization is everything. Your smartwatch isn’t just a timepiece—it’s an extension of your style. Thanks to innovative third-party developers, customizing your Apple Watch has reached new heights with stunning designs...

The Power of Digital Signage in Modern Marketing

In a fast-paced digital world, businesses must find innovative ways to capture consumer attention. Digital signage has emerged as a powerful solution, offering dynamic and engaging content that attracts and retains customers. From retail stores to ...

Why Cloud Computing Is the Future of IT Infrastructure for Enterprises

Globally, cloud computing is changing the way business organizations manage their IT infrastructure. It offers cheap, flexible and scalable solutions. Cloud technologies are applied in organizations to facilitate procedures and optimize operation...

First Nations Writers Festival

The First Nations Writers Festival (FNWF) is back for its highly anticipated 2025 edition, continuing its mission to celebrate the voices, cultures and traditions of First Nations communities through literature, art and storytelling. Set to take ...

Improving Website Performance with a Cloud VPS

Websites represent the new mantra of success. One slow website may make escape for visitors along with income too. Therefore it's an extra offer to businesses seeking better performance with more scalability and, thus represents an added attracti...

Why You Should Choose Digital Printing for Your Next Project

In the rapidly evolving world of print media, digital printing has emerged as a cornerstone technology that revolutionises how businesses and creative professionals produce printed materials. Offering unparalleled flexibility, speed, and quality, d...

LayBy Shopping