The Times Australia
The Times World News

.

8 surprising things data science has revealed about us over the past decade

  • Written by Paul X. McCarthy, Adjunct Professor, UNSW Sydney
8 surprising things data science has revealed about us over the past decade

Big data analysis has long supported major feats[1] in physics and astronomy. But more recently we’ve seen it underpin breakthroughs in the social sciences and humanities.

Since the landmark paper Computational Social Science[2] was published in 2009, a new generation of data analytics tools has given researchers insight into fundamental questions about how we communicate, who we are and what we value.

For instance, by analysing the relative frequency of certain words in historical texts, researchers can identify important changes in our use of language over time.

In some cases these shifts will be obvious, such as the use of archaic words being replaced by more contemporary words. But in other cases, they may reflect more subtle but widespread social and cultural changes. Below are some of the most influential data-centric discoveries from the past 10 years.

How we communicate

Over the past decade, a growing number of global open data sources have helped researchers reveal patterns in what we read, write and pay attention to. Google Books, Worldcat[3] and Project Gutenberg[4] are just some examples.

The release of the Google Books n-gram viewer[5] in the early 2010s was a game changer on this front. Using the entire Google Books database, this tool shows you the relative frequency of a specific term or phrase as it has been used over hundreds of years. Researchers[6] have used this data to explore the systematic suppression of the mention of Jewish painters, such as Marc Chagall, in German books during World War II.

Data analysis can also reveal patterns in the expression of human emotions over time. CSIRO’s We Feel[7] tracks emotions in communities around the world. It does this by analysing the language people are using on social media in real time and mapping it out.

The tool can be used to determine the general mood over time (hour by hour, day by day) within particular cities and countries. Patterns in these data can then be explored in association with other information, such as weather, holidays and economic fluctuations.

Some research findings even claim to represent fundamental changes in humans’ social values, community sentiment and how we think (for example, the rise and fall of words associated with rationality such as “method”, “analysis” and “determine”).

Here are some key findings in this space:

  • Cultural turnover is accelerating

    A Harvard University-led analysis[8] of more than a century of data from millions of books provides evidence that society’s attention span for historical events is declining, as appetite for new material grows.

    In other words, we are forgetting the past faster. You can see this in the graph below, which tracks how often three specific years are mentioned across a vast range of literature through time. As time passes, the “half-life” of each year (the point at which it receives just half the attention it had at its peak) comes quicker.

    Counts of mentions of the years 1883, 1910 and 1950 in all books for the past 200 years.
    Our collective attention for historical events has shrunk over the past century. Michel et al., Science 2010[9]
  • Human language diversity and biodiversity are correlated

    By mapping linguistic diversity and the diversity of animal species, researchers have shown[10] these two worlds are correlated geographically – both increasing with temperature and proximity to the equator. So the closer to the equator you get, the more variation there is in spoken language and the greater the variety of species there is.

    The authors propose this is due to heat near the equator producing greater productivity and variety in plant life, which in turn provides more complex and interactive environments for both animals and humans alike – feeding into a cycle whereby “diversity begets more diversity”.

    Three figures showing diversity distributions of language and animals and their relation to geography.
Researchers have shown both linguistic diversity and species diversity increase exponentially with temperature and proximity to the equator. Hamilton, Walker & Kempes, Scientific Reports 2020[11] There have been society-wide shifts in language use over the past century

In an article published[12] in December researchers used machine learning to show long-term, consistent changes in our use of language. Specifically, they reveal an inflection point in the 1980s where there is a shift towards more egocentric, emotional and supposedly less rational language.

The authors suggest (although not without contest[13]) this could signal the beginning of a “post-truth era”.

Who we are

In the field of psychology, the same data analytics tools have shown that people’s personalities can be measured using the “Big 5” traits, which largely become stable in adulthood[14].

This was possible thanks to extensive data sets such as HILDA in Australia, the German Socio-Economic Panel in Germany and the British Household Panel Survey in the UK.

Robust studies have also demonstrated that personality traits can be reliably and accurately predicted from a variety of data sources including voice recordings[15], mobile phone usage patterns[16] and even portrait photographs[17].

In turn, there have been some remarkable associations found at scale between personality and:

  • Elevation

    A study published in 2020, and based on more than three million people’s data, shows[18] mountain-dwelling people tend to have different personality traits than those who live at sea level. They are generally more open to new experiences and more emotionally stable.

  • Location

    Another earlier study shows people who live in the United States can be divided into three clear and measurable clusters[19] of personality types, linked with associated geographic footprints. New Yorkers and Texans (who are in the same cluster) are more likely to be temperamental and uninhibited.

  • Occupation

    In our own research published with colleagues in 2019, we analysed the personality features of people in more than 1,000 different occupations. We found[20] people in the same role share similar traits. Scientists are more open to new ideas yet ready to argue[21], whereas tennis professionals tend to be friendly and outgoing.

    The research used machine learning to infer the personality features of more than 100,000 people, based on language used on social media.

Read more: Robot career advisor: AI may soon be able to analyse your tweets to match you to a job[22]

What we value

In economics, we’re seeing major research frontiers being opened up thanks to data analysis, including in:

  • Network science

    When it comes to success, we’ve learnt that performance matters most when it can be measured (like in sport). But in other fields where it can’t be measured easily (like in the art world), networks matter[23] most[24].

  • Behavioural economics

    We can now see how we behave as individuals en masse, unveiling valuable clues for effective policy interventions around employment, taxation and education. For instance, one large-scale study[25] revealed those quickest to re-enter the workforce displayed certain key behaviours. These included being an early riser and being geographically mobile (perhaps meaning they’re more willing to travel further, or relocate, for work).

Post-theory science?

Some have argued data science poses a fundamental challenge to the traditional sciences, with the emergence of “post-theory science[26]”. This is the concept that machines are better at understanding the relationship between data and reality than the traditional scientific method of hypothesise, predict and test.

However, reports of the death of theory[27] are perhaps greatly exaggerated. Data are not perfect. And data science based on incomplete or biased data has the potential to miss, or mask, important patterns in human activity. This can only be addressed by critical thinking and theory.

Read more: Nobel economics prize winners showed economists how to turn the real world into their laboratory[28]

References

  1. ^ major feats (www.newscientist.com)
  2. ^ Computational Social Science (www.science.org)
  3. ^ Worldcat (www.worldcat.org)
  4. ^ Project Gutenberg (www.gutenberg.org)
  5. ^ n-gram viewer (books.google.com)
  6. ^ Researchers (www.scientificamerican.com)
  7. ^ We Feel (wefeel.csiro.au)
  8. ^ analysis (www.science.org)
  9. ^ Michel et al., Science 2010 (www.science.org)
  10. ^ shown (doi.org)
  11. ^ Hamilton, Walker & Kempes, Scientific Reports 2020 (www.nature.com)
  12. ^ published (www.pnas.org)
  13. ^ without contest (doi.org)
  14. ^ stable in adulthood (doi.org)
  15. ^ voice recordings (doi.org)
  16. ^ mobile phone usage patterns (doi.org)
  17. ^ portrait photographs (www.nature.com)
  18. ^ shows (www.nature.com)
  19. ^ three clear and measurable clusters (www.apa.org)
  20. ^ We found (www.pnas.org)
  21. ^ ready to argue (www.natureindex.com)
  22. ^ Robot career advisor: AI may soon be able to analyse your tweets to match you to a job (theconversation.com)
  23. ^ matter (doi.org)
  24. ^ most (www.science.org)
  25. ^ large-scale study (journals.plos.org)
  26. ^ post-theory science (www.theguardian.com)
  27. ^ death of theory (www.wired.com)
  28. ^ Nobel economics prize winners showed economists how to turn the real world into their laboratory (theconversation.com)

Read more https://theconversation.com/how-we-communicate-what-we-value-even-who-we-are-8-surprising-things-data-science-has-revealed-about-us-over-the-past-decade-176891

Times Magazine

What AI Adoption Means for the Future of Workplace Risk Management

Image by freepik As industrial operations become more complex and fast-paced, the risks faced by workers and employers alike continue to grow. Traditional safety models—reliant on manual oversight, reactive investigations, and standardised checklist...

From Beach Bops to Alpine Anthems: Your Sonos Survival Guide for a Long Weekend Escape

Alright, fellow adventurers and relaxation enthusiasts! So, you've packed your bags, charged your devices, and mentally prepared for that glorious King's Birthday long weekend. But hold on, are you really ready? Because a true long weekend warrior kn...

Effective Commercial Pest Control Solutions for a Safer Workplace

Keeping a workplace clean, safe, and free from pests is essential for maintaining productivity, protecting employee health, and upholding a company's reputation. Pests pose health risks, can cause structural damage, and can lead to serious legal an...

The Science Behind Reverse Osmosis and Why It Matters

What is reverse osmosis? Reverse osmosis (RO) is a water purification process that removes contaminants by forcing water through a semi-permeable membrane. This membrane allows only water molecules to pass through while blocking impurities such as...

Foodbank Queensland celebrates local hero for National Volunteer Week

Stephen Carey is a bit bananas.   He splits his time between his insurance broker business, caring for his young family, and volunteering for Foodbank Queensland one day a week. He’s even run the Bridge to Brisbane in a banana suit to raise mon...

Senior of the Year Nominations Open

The Allan Labor Government is encouraging all Victorians to recognise the valuable contributions of older members of our community by nominating them for the 2025 Victorian Senior of the Year Awards.  Minister for Ageing Ingrid Stitt today annou...

The Times Features

Ways to Attract Tenants in a Competitive Rental Market

In the kind of rental market we’ve got now, standing out is half the battle. The other half? Actually getting someone to sign that lease. With interest rates doing backflips and ...

Top Tips for Finding the Ideal Block to Build Your Home

There’s something deeply personal and exciting about building your own home. You’re not just choosing paint colours or furniture, you’re creating a space that reflects your lifes...

The Home Buying Process Explained Step by Step

Buying a home is a thrilling milestone, but it can also feel like navigating a maze without a map. With paperwork, finances, and decisions at every turn, understanding the home-b...

Thinking of Selling Your Home? Here’s What You Need to Know

Selling a home is more than just putting up a “For Sale” sign. It’s a strategic process that involves preparation, pricing, and negotiation - all aimed at getting the best value ...

Smart Ways to Earn Passive Income from Real Estate

Imagine making money without doing much work. You get paid even while you sleep, travel, or do fun things. This is called passive income. Indeed, real estate has great ways to do...

Small Details, Big Difference: How Minor Decor Tweaks Can Redefine Your Home

Have you ever walked into a home that felt effortlessly stylish, but you couldn’t quite figure out why? It’s often not about major renovations; it’s the small details that make a...