The Times Australia
Business and Money

From where we work to what we spend, the ABS knows more about us than ever before: here’s what’s changing

  • Written by Peter Martin, Visiting Fellow, Crawford School of Public Policy, Australian National University

How much were prices rising in January when Shadow Treasurer Angus Taylor said inflation was “rampant[1]”?

The prices that give us a good steer on inflation were falling, by 0.4%[2].

That’s the change that month in what the Bureau of Statistics calls the consumer price index “excluding volatile items”. The items it excludes (because they are often affected by supply disruptions[3]) are fruit, vegetables and fuel.

Apart from that, the measure of prices I just quoted is the best monthly measure of the prices of everything that households buy in the proportions they buy them.

Not all prices were falling. The price of alcohol was up, the price of bread was down, the price of rent was up, and the price of tourist accommodation was down. It’s only on balance (excluding volatile items) that prices fell.

This is the sort of thing we wouldn’t have known about until just a few years ago. Up until late 2022, the consumer price index was calculated only four times a year, and even that was a herculean feat.

A ten-fold increase in data

The bureau had to collect what used to be 100,000 separate prices[4] for each of those four surveys – a huge number collected in person, either over the phone (“hello, can you tell me your current price for…”) or in stores via handheld devices.

The cost to the bureau, and the number of staff involved, was enormous – big enough to make a monthly measure impossible, as important as that would have been to a Reserve Bank that set interest rates monthly and needed a monthly read on inflation.

Customer pays his purchase at self service checkout
Direct feeds from retailers are making price data more comprehensive and timely than ever before. Shutterstock[5]

But in the last few years the use of supermarket scanner data, “web scrapping[6]” to collect online prices, and data feeds direct from the computers of rental agents and all sorts of other businesses have cut costs enormously and increased the number of prices collected each quarter almost ten-fold to 900,000[7].

The bureau says the monthly index isn’t as comprehensive as the quarterly index yet, but it will be by the end of 2025, at which time the bureau will use it to replace[8] the quarterly index, delivering something of the same quality 12 times a year.

That’s just one of the ways in which an explosion of previously-inaccessible data is transforming the way the bureau goes about its job and is set to make statistics that used to be only fairly reliable suddenly very reliable.

Retail figures set for the chop

For more than half a century, every month since April 1961[9], the bureau has published an update on retail spending[10] – how much we are spending in shops.

The survey used to be quite useful. Back when it started, we did more than half our spending in shops. These days it’s only one third[11], the rest is on services.

And the retail survey was always a pretty rough-and-ready way to find out what we spent in shops. Each month the bureau surveys about 700 large businesses and 2,700[12] smaller businesses selected at random. It uses phone calls[13] and paper forms.

Meantime, in part due to the national emergency created by COVID, it’s been given access to something better. Australia’s big four banks agreed to give the bureau de-identified card and transaction data[14] to enable it to quickly get a handle on how much we were spending early in the pandemic, and they’ve kept providing it.

It turns out to be very good indeed. It covers far more retail outlets than the retail survey ever did, as well as spending on services and spending overseas, and it divides spending into categories based on the type of merchant[15].

It doesn’t directly cover what we spend in cash, but there’s a lot less[16] of that than there used to be. It'llreplace the retail survey from the middle of next year[17].

Millions instead of thousands

The mammoth monthly employment survey of 24,000 households[18] remains in place, as do the doorknocks that begin each household’s eight-month turn at completing the survey, but alongside it the bureau is developing a far more comprehensive measure using payroll data[19] submitted to the tax office.

While payroll numbers can’t tell us everything the employment survey does (they can’t yet tell us the hours people work and whether are looking for work) they cover millions of Australians instead of thousands, and come out weekly[20].

The bureau is doing the same sort of thing almost everywhere. For more than a century it has surveyed farmers to find out what they are growing. It’s begun supplementing that with data from satellites and the machines used on farms[21].

The ultimate goal of all of these changes, gathered together under the banner “Big Data, Timely Insights[22]” is to ask as few questions as possible. Why run a survey, when you can find out directly?

Read more: You can't fix it if you can't see it: how the ABS became our secret weapon[23]

Big data, timely insights

It’s far harder than it looks. A lot of the so-called administrative data[24] provided to banks and other organisations isn’t sorted in a way that makes it useful. That’s where the bureau is concentrating its efforts. The more it succeeds, the less it will need to bother us and the better the information it will produce.

In the meantime, here’s an update on those inflation figures, the ones that come out monthly. In February, the consumer price index excluding volatile items did not change, meaning in that particular month, inflation was zero[25].

Even better, adding the past six months together (and multiplying by two) gives you an annual inflation rate of 2.5% – slap bang in the middle of the Reserve Bank’s 2-3% target band, suggesting things are moving in the right direction.

It’s too early to declare victory over inflation that was at one stage heading towards 8%, but at the moment the monthly figures show things moving in the right direction.

If the direction changes, the bureau will tell us, quick smart.

References

  1. ^ rampant (www.angustaylor.com.au)
  2. ^ 0.4% (www.abs.gov.au)
  3. ^ often affected by supply disruptions (www.rba.gov.au)
  4. ^ 100,000 separate prices (www.ausstats.abs.gov.au)
  5. ^ Shutterstock (www.shutterstock.com)
  6. ^ web scrapping (kinsta.com)
  7. ^ 900,000 (www.abs.gov.au)
  8. ^ replace (consult.abs.gov.au)
  9. ^ April 1961 (www.ausstats.abs.gov.au)
  10. ^ retail spending (www.abs.gov.au)
  11. ^ one third (www.abs.gov.au)
  12. ^ 2,700 (www.abs.gov.au)
  13. ^ phone calls (www.abs.gov.au)
  14. ^ card and transaction data (theconversation.com)
  15. ^ type of merchant (www.abs.gov.au)
  16. ^ lot less (theconversation.com)
  17. ^ middle of next year (www.abs.gov.au)
  18. ^ 24,000 households (www.abs.gov.au)
  19. ^ payroll data (www.abs.gov.au)
  20. ^ weekly (www.abs.gov.au)
  21. ^ satellites and the machines used on farms (www.abs.gov.au)
  22. ^ Big Data, Timely Insights (www.abs.gov.au)
  23. ^ You can't fix it if you can't see it: how the ABS became our secret weapon (theconversation.com)
  24. ^ administrative data (www.abs.gov.au)
  25. ^ zero (www.abs.gov.au)

Authors: Peter Martin, Visiting Fellow, Crawford School of Public Policy, Australian National University

Read more https://theconversation.com/from-where-we-work-to-what-we-spend-the-abs-knows-more-about-us-than-ever-before-heres-whats-changing-226814

Business Times

Navigating Leadership Mistakes with Confidence

I am always surprised by this question: How do leaders get over embarrassing mistakes and still succeed? The use of the w...

Australia’s Grill’d Transforms Operations with Qlik

Boosting Burgers and Business Clean, connected data powers real-time insights, smarter staffing, and standout customer exp...

Agentforce for Financial Services: Merging AI and Human Expertise…

In this rapidly evolving world of financial services, deploying customer experiences that are personalized and intelligen...

The Times Features

Is our mental health determined by where we live – or is it the other way round? New research sheds more light

Ever felt like where you live is having an impact on your mental health? Turns out, you’re not imagining things. Our new analysis[1] of eight years of data from the New Zeal...

Going Off the Beaten Path? Here's How to Power Up Without the Grid

There’s something incredibly freeing about heading off the beaten path. No traffic, no crowded campsites, no glowing screens in every direction — just you, the landscape, and the...

West HQ is bringing in a season of culinary celebration this July

Western Sydney’s leading entertainment and lifestyle precinct is bringing the fire this July and not just in the kitchen. From $29 lobster feasts and award-winning Asian banque...

What Endo Took and What It Gave Me

From pain to purpose: how one woman turned endometriosis into a movement After years of misdiagnosis, hormone chaos, and major surgery, Jo Barry was done being dismissed. What beg...

Why Parents Must Break the Silence on Money and Start Teaching Financial Skills at Home

Australia’s financial literacy rates are in decline, and our kids are paying the price. Certified Money Coach and Financial Educator Sandra McGuire, who has over 20 years’ exp...

Australia’s Grill’d Transforms Operations with Qlik

Boosting Burgers and Business Clean, connected data powers real-time insights, smarter staffing, and standout customer experiences Sydney, Australia, 14 July 2025 – Qlik®, a g...