Review bombing is a dirty practice, but research shows games do benefit from online feedback
- Written by: Christian Moro, Associate Professor of Science & Medicine, Bond University
Online user reviews have come to play a crucial role[1] in our decisions about which products to buy, what TV to watch, and what games to play.
But after initial enthusiasm, many platforms have pushed back against them. Netflix’s star ratings and written user reviews[2] are a distant memory, and even YouTube no longer shows the number of “dislikes” a video receives[3].
Negativity in particular is a no-no. Instagram and Facebook will let you “like” a post, but if you dislike it they don’t want to know. Steam, the world’s largest distributor of PC games, has also struggled with negative reviews[4] – in particular, co-ordinated negative campaigns known as “review bombing”.
However, in recent research published in The Internet and Higher Education[5] we put a video game up for community review. After thousands of players and hundreds of written reviews we found that user feedback, properly managed, can lead to significant improvements.
Review bombing
One reason community reviews have become less popular is the rise of “review bombing”, the co-ordinated practice of leaving large numbers of negative user reviews[6] on a game or product in order to reduce its aggregate review score.
Most review-bombing incidents appear to stem from more than just not enjoying a game. They may be driven by ideological disagreement[7] with the content of the game or dislike of the actions[8] of a developer.
Other times this activity is automated by bots to suppress media or send a warning to companies. To take one example, a gaming review YouTube channel called Gamer’s Nexus recently reported that one of its videos exposing a scam had received an attack of co-ordinated “dislikes”[9].
Read more: Holographic teachers were supposed to be part of our future. What happened?[10]
Is removing reviews the answer?
When community reviews work, the consumer benefits[11] by getting real-world information from the users of a product.
On YouTube, for example, the removal of dislike counts[12] makes it hard to quickly assess the quality of a video. This is particularly important information for DIY or crafting videos.
The removal of dislikes also makes it more likely that a viewer will be caught out[13] by clickbait, or tricked into watching a video that does not host the content promised.
When the system works
Our new study[14] shows the advantages of community reviews. It demonstrates how, when handled carefully and objectively, community feedback can go a long way towards helping a game develop.
We made an educational game called The King’s Request[15] for use in a medical and health sciences program. The aim was to crowdsource more feedback than we could get from students in our classes, so we released the game for free on Steam.
Of the 16,000 players, 150 provided written reviews. We analysed this feedback, which in many cases provided ideas and methods, to improve the game.
The King’s Request: a game that has been enhanced for learning through community reviews.This is one example of where feedback from the gaming community, although opinionated in many cases, can genuinely help the development process[16], benefiting all stakeholders involved. This is particularly important as “serious” or educational games[17] are a growing component[18] of modern curriculums.
Censoring community reviews, even if the aim is to prevent misinformation, does make it harder for developers and educational designers[19] to receive feedback, for viewers to receive quick information, and for paying customers to have their voice.
Read more: Technology and learning in the classroom: six tips to get the balance right[20]
What is the future for community reviews?
The trend has been to remove negative community ratings. YouTube CEO Susan Wojcicki defended[21] the removal of dislike counts earlier this year, and Netflix appears to have no interest in bringing back[22] its five-star rating system.
However, not all outlets are following this trend. TikTok has been testing a dislike button for written contributions[23] in a way that enables the community to filter out unhelpful posts.
TikTok argues that, once released, this will foster authentic engagement[24] in the comment sections.
And the Epic Games Store, a competitor of Steam, recently implemented a system of random user surveys[25] to keep community feedback while avoiding review bombing. Google has also been trying new things, finding some success in tackling review bombing through artificial intelligence[26].
References
- ^ play a crucial role (pubsonline.informs.org)
- ^ reviews (mashable.com)
- ^ YouTube no longer shows the number of “dislikes” a video receives (www.searchenginejournal.com)
- ^ also struggled with negative reviews (www.theverge.com)
- ^ recent research published in The Internet and Higher Education (www.sciencedirect.com)
- ^ co-ordinated practice of leaving large numbers of negative user reviews (www.theguardian.com)
- ^ ideological disagreement (doi.org)
- ^ dislike of the actions (gamerant.com)
- ^ received an attack of co-ordinated “dislikes” (www.youtube.com)
- ^ Holographic teachers were supposed to be part of our future. What happened? (theconversation.com)
- ^ the consumer benefits (www.accc.gov.au)
- ^ removal of dislike counts (www.forbes.com)
- ^ caught out (www.bbc.com)
- ^ new study (doi.org)
- ^ The King’s Request (www.youtube.com)
- ^ development process (doi.org)
- ^ “serious” or educational games (journals.physiology.org)
- ^ growing component (link.springer.com)
- ^ educational designers (www.sciencedirect.com)
- ^ Technology and learning in the classroom: six tips to get the balance right (theconversation.com)
- ^ defended (www.searchenginejournal.com)
- ^ bringing back (variety.com)
- ^ written contributions (www.cnet.com)
- ^ authentic engagement (newsroom.tiktok.com)
- ^ a system of random user surveys (store.epicgames.com)
- ^ artificial intelligence (www.engadget.com)
