The Times Australia
The Times World News

.

8 surprising things data science has revealed about us over the past decade

  • Written by Paul X. McCarthy, Adjunct Professor, UNSW Sydney
8 surprising things data science has revealed about us over the past decade

Big data analysis has long supported major feats[1] in physics and astronomy. But more recently we’ve seen it underpin breakthroughs in the social sciences and humanities.

Since the landmark paper Computational Social Science[2] was published in 2009, a new generation of data analytics tools has given researchers insight into fundamental questions about how we communicate, who we are and what we value.

For instance, by analysing the relative frequency of certain words in historical texts, researchers can identify important changes in our use of language over time.

In some cases these shifts will be obvious, such as the use of archaic words being replaced by more contemporary words. But in other cases, they may reflect more subtle but widespread social and cultural changes. Below are some of the most influential data-centric discoveries from the past 10 years.

How we communicate

Over the past decade, a growing number of global open data sources have helped researchers reveal patterns in what we read, write and pay attention to. Google Books, Worldcat[3] and Project Gutenberg[4] are just some examples.

The release of the Google Books n-gram viewer[5] in the early 2010s was a game changer on this front. Using the entire Google Books database, this tool shows you the relative frequency of a specific term or phrase as it has been used over hundreds of years. Researchers[6] have used this data to explore the systematic suppression of the mention of Jewish painters, such as Marc Chagall, in German books during World War II.

Data analysis can also reveal patterns in the expression of human emotions over time. CSIRO’s We Feel[7] tracks emotions in communities around the world. It does this by analysing the language people are using on social media in real time and mapping it out.

The tool can be used to determine the general mood over time (hour by hour, day by day) within particular cities and countries. Patterns in these data can then be explored in association with other information, such as weather, holidays and economic fluctuations.

Some research findings even claim to represent fundamental changes in humans’ social values, community sentiment and how we think (for example, the rise and fall of words associated with rationality such as “method”, “analysis” and “determine”).

Here are some key findings in this space:

  • Cultural turnover is accelerating

    A Harvard University-led analysis[8] of more than a century of data from millions of books provides evidence that society’s attention span for historical events is declining, as appetite for new material grows.

    In other words, we are forgetting the past faster. You can see this in the graph below, which tracks how often three specific years are mentioned across a vast range of literature through time. As time passes, the “half-life” of each year (the point at which it receives just half the attention it had at its peak) comes quicker.

    Counts of mentions of the years 1883, 1910 and 1950 in all books for the past 200 years.
    Our collective attention for historical events has shrunk over the past century. Michel et al., Science 2010[9]
  • Human language diversity and biodiversity are correlated

    By mapping linguistic diversity and the diversity of animal species, researchers have shown[10] these two worlds are correlated geographically – both increasing with temperature and proximity to the equator. So the closer to the equator you get, the more variation there is in spoken language and the greater the variety of species there is.

    The authors propose this is due to heat near the equator producing greater productivity and variety in plant life, which in turn provides more complex and interactive environments for both animals and humans alike – feeding into a cycle whereby “diversity begets more diversity”.

    Three figures showing diversity distributions of language and animals and their relation to geography.
Researchers have shown both linguistic diversity and species diversity increase exponentially with temperature and proximity to the equator. Hamilton, Walker & Kempes, Scientific Reports 2020[11] There have been society-wide shifts in language use over the past century

In an article published[12] in December researchers used machine learning to show long-term, consistent changes in our use of language. Specifically, they reveal an inflection point in the 1980s where there is a shift towards more egocentric, emotional and supposedly less rational language.

The authors suggest (although not without contest[13]) this could signal the beginning of a “post-truth era”.

Who we are

In the field of psychology, the same data analytics tools have shown that people’s personalities can be measured using the “Big 5” traits, which largely become stable in adulthood[14].

This was possible thanks to extensive data sets such as HILDA in Australia, the German Socio-Economic Panel in Germany and the British Household Panel Survey in the UK.

Robust studies have also demonstrated that personality traits can be reliably and accurately predicted from a variety of data sources including voice recordings[15], mobile phone usage patterns[16] and even portrait photographs[17].

In turn, there have been some remarkable associations found at scale between personality and:

  • Elevation

    A study published in 2020, and based on more than three million people’s data, shows[18] mountain-dwelling people tend to have different personality traits than those who live at sea level. They are generally more open to new experiences and more emotionally stable.

  • Location

    Another earlier study shows people who live in the United States can be divided into three clear and measurable clusters[19] of personality types, linked with associated geographic footprints. New Yorkers and Texans (who are in the same cluster) are more likely to be temperamental and uninhibited.

  • Occupation

    In our own research published with colleagues in 2019, we analysed the personality features of people in more than 1,000 different occupations. We found[20] people in the same role share similar traits. Scientists are more open to new ideas yet ready to argue[21], whereas tennis professionals tend to be friendly and outgoing.

    The research used machine learning to infer the personality features of more than 100,000 people, based on language used on social media.

Read more: Robot career advisor: AI may soon be able to analyse your tweets to match you to a job[22]

What we value

In economics, we’re seeing major research frontiers being opened up thanks to data analysis, including in:

  • Network science

    When it comes to success, we’ve learnt that performance matters most when it can be measured (like in sport). But in other fields where it can’t be measured easily (like in the art world), networks matter[23] most[24].

  • Behavioural economics

    We can now see how we behave as individuals en masse, unveiling valuable clues for effective policy interventions around employment, taxation and education. For instance, one large-scale study[25] revealed those quickest to re-enter the workforce displayed certain key behaviours. These included being an early riser and being geographically mobile (perhaps meaning they’re more willing to travel further, or relocate, for work).

Post-theory science?

Some have argued data science poses a fundamental challenge to the traditional sciences, with the emergence of “post-theory science[26]”. This is the concept that machines are better at understanding the relationship between data and reality than the traditional scientific method of hypothesise, predict and test.

However, reports of the death of theory[27] are perhaps greatly exaggerated. Data are not perfect. And data science based on incomplete or biased data has the potential to miss, or mask, important patterns in human activity. This can only be addressed by critical thinking and theory.

Read more: Nobel economics prize winners showed economists how to turn the real world into their laboratory[28]

References

  1. ^ major feats (www.newscientist.com)
  2. ^ Computational Social Science (www.science.org)
  3. ^ Worldcat (www.worldcat.org)
  4. ^ Project Gutenberg (www.gutenberg.org)
  5. ^ n-gram viewer (books.google.com)
  6. ^ Researchers (www.scientificamerican.com)
  7. ^ We Feel (wefeel.csiro.au)
  8. ^ analysis (www.science.org)
  9. ^ Michel et al., Science 2010 (www.science.org)
  10. ^ shown (doi.org)
  11. ^ Hamilton, Walker & Kempes, Scientific Reports 2020 (www.nature.com)
  12. ^ published (www.pnas.org)
  13. ^ without contest (doi.org)
  14. ^ stable in adulthood (doi.org)
  15. ^ voice recordings (doi.org)
  16. ^ mobile phone usage patterns (doi.org)
  17. ^ portrait photographs (www.nature.com)
  18. ^ shows (www.nature.com)
  19. ^ three clear and measurable clusters (www.apa.org)
  20. ^ We found (www.pnas.org)
  21. ^ ready to argue (www.natureindex.com)
  22. ^ Robot career advisor: AI may soon be able to analyse your tweets to match you to a job (theconversation.com)
  23. ^ matter (doi.org)
  24. ^ most (www.science.org)
  25. ^ large-scale study (journals.plos.org)
  26. ^ post-theory science (www.theguardian.com)
  27. ^ death of theory (www.wired.com)
  28. ^ Nobel economics prize winners showed economists how to turn the real world into their laboratory (theconversation.com)

Read more https://theconversation.com/how-we-communicate-what-we-value-even-who-we-are-8-surprising-things-data-science-has-revealed-about-us-over-the-past-decade-176891

Times Magazine

When Touchscreens Turn Temperamental: What to Do Before You Panic

When your touchscreen starts acting up, ignoring taps, registering phantom touches, or freezing entirely, it can feel like your entire setup is falling apart. Before you rush to replace the device, it’s worth taking a deep breath and exploring what c...

Why Social Media Marketing Matters for Businesses in Australia

Today social media is a big part of daily life. All over Australia people use Facebook, Instagram, TikTok , LinkedIn and Twitter to stay connected, share updates and find new ideas. For businesses this means a great chance to reach new customers and...

Building an AI-First Culture in Your Company

AI isn't just something to think about anymore - it's becoming part of how we live and work, whether we like it or not. At the office, it definitely helps us move faster. But here's the thing: just using tools like ChatGPT or plugging AI into your wo...

Data Management Isn't Just About Tech—Here’s Why It’s a Human Problem Too

Photo by Kevin Kuby Manuel O. Diaz Jr.We live in a world drowning in data. Every click, swipe, medical scan, and financial transaction generates information, so much that managing it all has become one of the biggest challenges of our digital age. Bu...

Headless CMS in Digital Twins and 3D Product Experiences

Image by freepik As the metaverse becomes more advanced and accessible, it's clear that multiple sectors will use digital twins and 3D product experiences to visualize, connect, and streamline efforts better. A digital twin is a virtual replica of ...

The Decline of Hyper-Casual: How Mid-Core Mobile Games Took Over in 2025

In recent years, the mobile gaming landscape has undergone a significant transformation, with mid-core mobile games emerging as the dominant force in app stores by 2025. This shift is underpinned by changing user habits and evolving monetization tr...

The Times Features

Why Mobile Allied Therapy Services Are Essential in Post-Hospital Recovery

Mobile allied health services matter more than ever under recent NDIA travel funding cuts. A quiet but critical shift is unfolding in Australia’s healthcare landscape. Mobile all...

Sydney Fertility Specialist – Expert IVF Treatment for Your Parenthood Journey

Improving the world with the help of a new child is the most valuable dream of many couples. To the infertile, though, this process can be daunting. It is here that a Sydney Fertil...

Could we one day get vaccinated against the gastro bug norovirus? Here’s where scientists are at

Norovirus is the leading cause[1] of acute gastroenteritis outbreaks worldwide. It’s responsible for roughly one in every five cases[2] of gastro annually. Sometimes dubbed ...

Does running ruin your knees? And how old is too old to start?

You’ve probably heard that running is tough on your knees – and even that it can cause long-term damage. But is this true? Running is a relatively high-impact activity. Eve...

Jetstar announces first ever Brisbane to Rarotonga flights with launch fares from just $249^ one-way

Jetstar will start operating direct flights between Brisbane and Rarotonga, the stunning capital island of the Cook Islands, in May 2026, with launch sale fares available today...

Introducing the SE 2 and Mini hair dryers from Laifen

The Mane Attractions for Professional Styling at Home Without the Price Tag Fast, flawless hair is now possible with the launch of Laifen’s two professional quality hair dryers th...