We need to change the way universities assess students, starting with these 3 things
- Written by Joanna Tai, Senior Research Fellow, Deakin University
This article is part of our series on big ideas for the Universities Accord[1]. The federal government is calling ideas to “reshape and reimagine higher education, and set it up for the next decade and beyond”. A review team is due to finish a draft report in June and a final report in December 2023.
Compulsory tests, essays, regular grades and timed exams are considered a given in university life. But the Universities Accord[2] should change this.
Rigid, traditional assessments need to make way for a more flexible, personalised way of working out what students know and can do. The current system is not only vulnerable to cheating, it also disadvantages those with disability and doesn’t give students the feedback they need.
Read more: Introducing our new series on the future of Australian higher education[3]
Students with disability need a different approach
Our research[4] shows university students with a disability are disadvantaged by current assessment formats. It shows adjustments – which are legally required for those with disabilities[5] – don’t always adequately compensate students.
For example, a common adjustment such as extra time[6] for an essay or exam may not be suitable for students with a disability, whose outputs can be affected regardless of time.
Students in our research also reported that accessible spaces and equipment – such as an ergonomic chair – were not reliably available during exams. Even in online exams, text-to-speech software and other assistive technologies are not necessarily compatible with all course materials or assignment file formats.
Just over 7% of university students reported a disability when they enrolled[7] in 2020. This is far less than 17.7% in the general population [8], which suggests there may be a hidden population[9] of students with disabilities who could be better supported, or even that prospective students with a disability are discouraged from enrolling at all.
Research has shown students are hesitant to get an adjustment due to fear of stigmatisation[10], and experience anxiety or shame over requests for extra assistance to demonstrate their learning.
Cottonbro Studio/PexelsAI has radically changed the playing field
At the same time, the rise of generative artificial intelligence tools such as ChatGPT[11] has shown universities need to rethink assessments so as to protect academic integrity.
We know ChatGPT can write material that is good enough to pass exams[12]. So essays and take-home assignments that simply ask students to provide chunks of information will no longer work.
Assessments will need to evaluate more sophisticated capabilities, such as critical thinking[13], to prevent cheating and demonstrate students’ learning.
Read more: ChatGPT is the push higher education needs to rethink assessment[14]
We also need to do better with feedback
Feedback is an incredibly important part of learning[15] but current assessment approaches obscure helpful feedback to students.
Feedback should happen throughout courses, not just with essays and exams.To have the best impact on learning, feedback should not happen at the same time as students get their marks or final grade[16].
Instead, it should happen when students need it most: during the semester, so they can use it in subsequent tasks. Comments might be verbal, written or in multimedia formats[17], and come from lecturers, tutors, peers[18] or even industry[19].
Many students fail a unit or exam at some point[20] in their academic career. The coupling of assessment and feedback frequently means important messages are ignored or lost[21].
Survey research[22] also shows about 15% of students are dissatisfied with the feedback they get, and this rises if students have a disability or are an international student.
How to improve assessment
There is a lot that could be done to improve assessment. But here are three significant changes we should focus on immediately:
1. We need to replace regular marks with regular feedback
Rather than final grades for every unit, students should receive regular comments about improving their work.
Then, at the end of their degree, selected assessments or a final project can be used to demonstrate a student’s learning.
Students might also be encouraged to portray their achievements[23] in more contextual and personal ways. They might be able to choose between blog entries or multimedia. Or they might put together a “persuasive portfolio”, which enables students to construct their own evidence of how they are progressing towards course learning outcomes.
Targeting feedback to students’ specific goals is also highly motivating and leads to improved performance[24].
This will mean society - including employers - can be more confident that graduates have developed relevant high-level capabilities, rather than immediately forgetting the contents of an exam once it’s over.
This approach is also more inclusive[25]. When individual tasks are considered separately, some formats might advantage particular students. But considering a range of tasks allows students to demonstrate their learning in a way that suits them.
Shutterstock2. Students should have choice in assessment
Assessment should promote individuality[26]. It should provide choices for students to demonstrate their achievements, to ensure they meet their goals for their future lives.
For example, students studying public health might choose to develop a policy briefing or community education resources on a topic of their choice: both options can demonstrate understanding of a health issue and relevant communication techniques.
Impersonal, cookie-cutter assessments[27] – such as a take-home exam or essay – are vulnerable to cheating. They also won’t teach students how to respond flexibly to evolving work environments.
Offering choice in assessment can also reduce anxiety and improve confidence[28] in study as students are doing tasks that are more meaningful to them.
3. All assessment should be inclusive
All assessments need to be designed in ways to minimise additional challenges[29] for students with disabilities or learning differences. Universal assessment design is one approach[30] universities can use here.
This means ensuring instructions, resources, and submissions take multiple formats (for example, text and audiovisual).
We found even small changes, such as allowing students to take notes and read instructions out aloud in reading time, reduced anxiety for those with learning differences[31].
If implemented as a matter of routine, assessment for inclusion[32] has the potential to improve the learning experience of many students from diverse backgrounds. Rather than just the ones who know about, and feel comfortable enough, to ask for help.
Read more: Why arts degrees and other generalist programs are the future of Australian higher education[33]
References
- ^ big ideas for the Universities Accord (theconversation.com)
- ^ Universities Accord (theconversation.com)
- ^ Introducing our new series on the future of Australian higher education (theconversation.com)
- ^ Our research (www.taylorfrancis.com)
- ^ legally required for those with disabilities (humanrights.gov.au)
- ^ such as extra time (doi.org)
- ^ reported a disability when they enrolled (www.education.gov.au)
- ^ 17.7% in the general population (www.abs.gov.au)
- ^ hidden population (link.springer.com)
- ^ fear of stigmatisation (doi.org)
- ^ such as ChatGPT (theconversation.com)
- ^ good enough to pass exams (edition.cnn.com)
- ^ critical thinking (theconversation.com)
- ^ ChatGPT is the push higher education needs to rethink assessment (theconversation.com)
- ^ incredibly important part of learning (feedbackforlearning.org)
- ^ marks or final grade (theconversation.com)
- ^ multimedia formats (www.tandfonline.com)
- ^ peers (www.tandfonline.com)
- ^ even industry (www.tandfonline.com)
- ^ fail a unit or exam at some point (doi.org)
- ^ important messages are ignored or lost (www.tandfonline.com)
- ^ research (theconversation.com)
- ^ portray their achievements (www.tandfonline.com)
- ^ highly motivating and leads to improved performance (www.tandfonline.com)
- ^ more inclusive (www.tandfonline.com)
- ^ should promote individuality (www.tandfonline.com)
- ^ cookie-cutter assessments (theconversation.com)
- ^ reduce anxiety and improve confidence (www.tandfonline.com)
- ^ minimise additional challenges (doi.org)
- ^ one approach (www.taylorfrancis.com)
- ^ reduced anxiety for those with learning differences (www.ncsehe.edu.au)
- ^ assessment for inclusion (doi.org)
- ^ Why arts degrees and other generalist programs are the future of Australian higher education (theconversation.com)