The Times Australia
The Times World News

.

8 surprising things data science has revealed about us over the past decade

  • Written by Paul X. McCarthy, Adjunct Professor, UNSW Sydney
8 surprising things data science has revealed about us over the past decade

Big data analysis has long supported major feats[1] in physics and astronomy. But more recently we’ve seen it underpin breakthroughs in the social sciences and humanities.

Since the landmark paper Computational Social Science[2] was published in 2009, a new generation of data analytics tools has given researchers insight into fundamental questions about how we communicate, who we are and what we value.

For instance, by analysing the relative frequency of certain words in historical texts, researchers can identify important changes in our use of language over time.

In some cases these shifts will be obvious, such as the use of archaic words being replaced by more contemporary words. But in other cases, they may reflect more subtle but widespread social and cultural changes. Below are some of the most influential data-centric discoveries from the past 10 years.

How we communicate

Over the past decade, a growing number of global open data sources have helped researchers reveal patterns in what we read, write and pay attention to. Google Books, Worldcat[3] and Project Gutenberg[4] are just some examples.

The release of the Google Books n-gram viewer[5] in the early 2010s was a game changer on this front. Using the entire Google Books database, this tool shows you the relative frequency of a specific term or phrase as it has been used over hundreds of years. Researchers[6] have used this data to explore the systematic suppression of the mention of Jewish painters, such as Marc Chagall, in German books during World War II.

Data analysis can also reveal patterns in the expression of human emotions over time. CSIRO’s We Feel[7] tracks emotions in communities around the world. It does this by analysing the language people are using on social media in real time and mapping it out.

The tool can be used to determine the general mood over time (hour by hour, day by day) within particular cities and countries. Patterns in these data can then be explored in association with other information, such as weather, holidays and economic fluctuations.

Some research findings even claim to represent fundamental changes in humans’ social values, community sentiment and how we think (for example, the rise and fall of words associated with rationality such as “method”, “analysis” and “determine”).

Here are some key findings in this space:

  • Cultural turnover is accelerating

    A Harvard University-led analysis[8] of more than a century of data from millions of books provides evidence that society’s attention span for historical events is declining, as appetite for new material grows.

    In other words, we are forgetting the past faster. You can see this in the graph below, which tracks how often three specific years are mentioned across a vast range of literature through time. As time passes, the “half-life” of each year (the point at which it receives just half the attention it had at its peak) comes quicker.

    Counts of mentions of the years 1883, 1910 and 1950 in all books for the past 200 years.
    Our collective attention for historical events has shrunk over the past century. Michel et al., Science 2010[9]
  • Human language diversity and biodiversity are correlated

    By mapping linguistic diversity and the diversity of animal species, researchers have shown[10] these two worlds are correlated geographically – both increasing with temperature and proximity to the equator. So the closer to the equator you get, the more variation there is in spoken language and the greater the variety of species there is.

    The authors propose this is due to heat near the equator producing greater productivity and variety in plant life, which in turn provides more complex and interactive environments for both animals and humans alike – feeding into a cycle whereby “diversity begets more diversity”.

    Three figures showing diversity distributions of language and animals and their relation to geography.
Researchers have shown both linguistic diversity and species diversity increase exponentially with temperature and proximity to the equator. Hamilton, Walker & Kempes, Scientific Reports 2020[11] There have been society-wide shifts in language use over the past century

In an article published[12] in December researchers used machine learning to show long-term, consistent changes in our use of language. Specifically, they reveal an inflection point in the 1980s where there is a shift towards more egocentric, emotional and supposedly less rational language.

The authors suggest (although not without contest[13]) this could signal the beginning of a “post-truth era”.

Who we are

In the field of psychology, the same data analytics tools have shown that people’s personalities can be measured using the “Big 5” traits, which largely become stable in adulthood[14].

This was possible thanks to extensive data sets such as HILDA in Australia, the German Socio-Economic Panel in Germany and the British Household Panel Survey in the UK.

Robust studies have also demonstrated that personality traits can be reliably and accurately predicted from a variety of data sources including voice recordings[15], mobile phone usage patterns[16] and even portrait photographs[17].

In turn, there have been some remarkable associations found at scale between personality and:

  • Elevation

    A study published in 2020, and based on more than three million people’s data, shows[18] mountain-dwelling people tend to have different personality traits than those who live at sea level. They are generally more open to new experiences and more emotionally stable.

  • Location

    Another earlier study shows people who live in the United States can be divided into three clear and measurable clusters[19] of personality types, linked with associated geographic footprints. New Yorkers and Texans (who are in the same cluster) are more likely to be temperamental and uninhibited.

  • Occupation

    In our own research published with colleagues in 2019, we analysed the personality features of people in more than 1,000 different occupations. We found[20] people in the same role share similar traits. Scientists are more open to new ideas yet ready to argue[21], whereas tennis professionals tend to be friendly and outgoing.

    The research used machine learning to infer the personality features of more than 100,000 people, based on language used on social media.

Read more: Robot career advisor: AI may soon be able to analyse your tweets to match you to a job[22]

What we value

In economics, we’re seeing major research frontiers being opened up thanks to data analysis, including in:

  • Network science

    When it comes to success, we’ve learnt that performance matters most when it can be measured (like in sport). But in other fields where it can’t be measured easily (like in the art world), networks matter[23] most[24].

  • Behavioural economics

    We can now see how we behave as individuals en masse, unveiling valuable clues for effective policy interventions around employment, taxation and education. For instance, one large-scale study[25] revealed those quickest to re-enter the workforce displayed certain key behaviours. These included being an early riser and being geographically mobile (perhaps meaning they’re more willing to travel further, or relocate, for work).

Post-theory science?

Some have argued data science poses a fundamental challenge to the traditional sciences, with the emergence of “post-theory science[26]”. This is the concept that machines are better at understanding the relationship between data and reality than the traditional scientific method of hypothesise, predict and test.

However, reports of the death of theory[27] are perhaps greatly exaggerated. Data are not perfect. And data science based on incomplete or biased data has the potential to miss, or mask, important patterns in human activity. This can only be addressed by critical thinking and theory.

Read more: Nobel economics prize winners showed economists how to turn the real world into their laboratory[28]

References

  1. ^ major feats (www.newscientist.com)
  2. ^ Computational Social Science (www.science.org)
  3. ^ Worldcat (www.worldcat.org)
  4. ^ Project Gutenberg (www.gutenberg.org)
  5. ^ n-gram viewer (books.google.com)
  6. ^ Researchers (www.scientificamerican.com)
  7. ^ We Feel (wefeel.csiro.au)
  8. ^ analysis (www.science.org)
  9. ^ Michel et al., Science 2010 (www.science.org)
  10. ^ shown (doi.org)
  11. ^ Hamilton, Walker & Kempes, Scientific Reports 2020 (www.nature.com)
  12. ^ published (www.pnas.org)
  13. ^ without contest (doi.org)
  14. ^ stable in adulthood (doi.org)
  15. ^ voice recordings (doi.org)
  16. ^ mobile phone usage patterns (doi.org)
  17. ^ portrait photographs (www.nature.com)
  18. ^ shows (www.nature.com)
  19. ^ three clear and measurable clusters (www.apa.org)
  20. ^ We found (www.pnas.org)
  21. ^ ready to argue (www.natureindex.com)
  22. ^ Robot career advisor: AI may soon be able to analyse your tweets to match you to a job (theconversation.com)
  23. ^ matter (doi.org)
  24. ^ most (www.science.org)
  25. ^ large-scale study (journals.plos.org)
  26. ^ post-theory science (www.theguardian.com)
  27. ^ death of theory (www.wired.com)
  28. ^ Nobel economics prize winners showed economists how to turn the real world into their laboratory (theconversation.com)

Read more https://theconversation.com/how-we-communicate-what-we-value-even-who-we-are-8-surprising-things-data-science-has-revealed-about-us-over-the-past-decade-176891

Times Magazine

Headless CMS in Digital Twins and 3D Product Experiences

Image by freepik As the metaverse becomes more advanced and accessible, it's clear that multiple sectors will use digital twins and 3D product experiences to visualize, connect, and streamline efforts better. A digital twin is a virtual replica of ...

The Decline of Hyper-Casual: How Mid-Core Mobile Games Took Over in 2025

In recent years, the mobile gaming landscape has undergone a significant transformation, with mid-core mobile games emerging as the dominant force in app stores by 2025. This shift is underpinned by changing user habits and evolving monetization tr...

Understanding ITIL 4 and PRINCE2 Project Management Synergy

Key Highlights ITIL 4 focuses on IT service management, emphasising continual improvement and value creation through modern digital transformation approaches. PRINCE2 project management supports systematic planning and execution of projects wit...

What AI Adoption Means for the Future of Workplace Risk Management

Image by freepik As industrial operations become more complex and fast-paced, the risks faced by workers and employers alike continue to grow. Traditional safety models—reliant on manual oversight, reactive investigations, and standardised checklist...

From Beach Bops to Alpine Anthems: Your Sonos Survival Guide for a Long Weekend Escape

Alright, fellow adventurers and relaxation enthusiasts! So, you've packed your bags, charged your devices, and mentally prepared for that glorious King's Birthday long weekend. But hold on, are you really ready? Because a true long weekend warrior kn...

Effective Commercial Pest Control Solutions for a Safer Workplace

Keeping a workplace clean, safe, and free from pests is essential for maintaining productivity, protecting employee health, and upholding a company's reputation. Pests pose health risks, can cause structural damage, and can lead to serious legal an...

The Times Features

Tricia Paoluccio designer to the stars

The Case for Nuturing Creativity in the Classroom, and in our Lives I am an actress and an artist who has had the privilege of sharing my work across many countries, touring my ...

Duke of Dural to Get Rooftop Bar as New Owners Invest in Venue Upgrade

The Duke of Dural, in Sydney’s north-west, is set for a major uplift under new ownership, following its acquisition by hospitality group Good Beer Company this week. Led by resp...

Prefab’s Second Life: Why Australia’s Backyard Boom Needs a Circular Makeover

The humble granny flat is being reimagined not just as a fix for housing shortages, but as a cornerstone of circular, factory-built architecture. But are our systems ready to s...

Melbourne’s Burglary Boom: Break-Ins Surge Nearly 25%

Victorian homeowners are being warned to act now, as rising break-ins and falling arrest rates paint a worrying picture for suburban safety. Melbourne residents are facing an ...

Exploring the Curriculum at a Modern Junior School in Melbourne

Key Highlights The curriculum at junior schools emphasises whole-person development, catering to children’s physical, emotional, and intellectual needs. It ensures early year...

Distressed by all the bad news? Here’s how to stay informed but still look after yourself

If you’re feeling like the news is particularly bad at the moment, you’re not alone. But many of us can’t look away – and don’t want to. Engaging with news can help us make ...