Hero Image

Assessment 2020

made-with-Markdown

Seven Propositions for Assessment Reform in Higher Education

This post is a derivative of Boud, D. and Associates (2010). Assessment 2020: Seven propositions for assessment reform in higher education. Sydney: Australian Learning and Teaching Council.

It is published here without any changes except for the format and styling, and under the original Creative Commons license.

forthebadge cc-nc-sa

Preamble

Universities face substantial change in a rapidly evolving global context. The challenges of meeting new expectations about academic standards in the next decade and beyond mean that assessment will need to be rethought and renewed.

This document provides a stimulus for those involved in the redevelopment of assessment practices. It draws on the expertise of a group of highly experienced assessment researchers, academic development practitioners and senior academic managers to identify current best thinking about the ways assessment will need to address immediate and future demands.

Underpinning principles

  • Assessment is a central feature of teaching and the curriculum. It powerfully frames how students learn and what students achieve. It is one of the most significant influences on students’ experience of higher education and all that they gain from it. The reason for an explicit focus on improving assessment practice is the huge impact it has on the quality of learning.
  • Assessment is the making of judgements about how students’ work meets appropriate standards. Teachers, markers and examiners have traditionally been charged with that responsibility. However, students themselves need to develop the capacity to make judgements about both their own work and that of others in order to become effective continuing learners and practitioners.
  • Assessment plays a key role in both fostering learning and the certification of students. However, unless it first satisfies the educational purpose of ensuring students can identify high quality work and can relate this knowledge to their own work, the likelihood that they will reach high standards themselves is much reduced.

The purposes of the propositions

The propositions have been developed to guide assessment thinking in the light of the increasing focus on standards, and to address criticisms of current practice. They set directions for change designed to enhance learning achievements for all students and improve the quality of their experience.

The propositions, however, do not stand alone. They must be considered within overall curriculum thinking alongside teaching and learning strategies and changing disciplinary content. They need to be supported by a range of development opportunities to foster the shifts in thinking and practice on the part of teaching staff and students that they imply.

The propositions are posed in a form that needs to be embraced and be taken up at different levels - specifically, by educational institutions, by programs and courses of study, and by those responsible for teaching and learning. They have implications for resources and the nature of workload; when addressed thoughtfully they may contribute to reduced costs through a better focusing of effort on those features of the curriculum and teaching that have most direct impact on learning.

Assessment has most effect when...

/user/pages/05.blog/assessment-reform/04._productive/1.png

... assessment is designed to focus students on learning

To improve student engagement in learning, and to support better quality learning outcomes, it is necessary that assessment tasks are designed to direct student attention to what needs to be learned and to the activities that best lead to this. Effective learning can be hampered by assessment tasks that focus student attention on grades and marks or reproductive thinking.

... assessment is recognised as a learning activity that requires engagement on appropriate tasks.

Assessment tasks should be significant learning activities in themselves, and not only enable judgements to be made about what has been learned. The potency of student engagement in learning is enhanced when assessment tasks require substantial involvement over time, and when they are designed in an interlinked, constructive, organised and coherent sequence.

/user/pages/05.blog/assessment-reform/05._learning/2.png

... feedback is informative and supportive and facilitates a positive attitude to future learning.

Students benefit from clear and helpful feedback on their learning. Everyday learning activities as well as special tasks and tests provide opportunities for the provision of feedback. This places responsibility on staff to plan assessment in order to (a) develop their own skills in providing quality feedback, and (b) develop in students the skills they need to provide sound feedback to each other.

... students seek and use timely feedback to improve the quality of their learning and work.

Students’ own skills of judgement are developed by their utilisation of feedback, guidance provided by those already inducted into the culture and standards of the discipline, and opportunities to grow their own skills of critical appraisal. They need to be able to seek and employ feedback from a variety of sources to develop a full range of outcomes from their studies.

... students regularly receive specific information, not just marks and grades, about how to improve the quality of their work.

Marks and grades provide little information to students about specific qualities of their work and do not indicate how it might be improved. While marks and grades may provide a crude tracking measure of how well students are doing, they do not help students move beyond their present standard of performance. Specific and detailed information is needed to show students what has been done well, what has not, and how their work could be better.

/user/pages/05.blog/assessment-reform/06._partners/3.png

... students progressively take responsibility for assessment and feedback procesess.

The overall aims of higher education include developing students’ critical thinking abilities, which include self-critique, independent judgement, and other skills for continuing learning. Personal responsibility for assessing performance and providing and responding to feedback is a desired graduate outcome. It is necessary and appropriate for university programs to foster this development throughout the curriculum.

... students develop and demonstrate the ability to judge the quality of their own work and the work of others against agreed standards.

Students need confidence and competence in making informed judgements about what they produce. They need to develop the ability to evaluate the quality, completeness and/or accuracy of work with respect to appropriate standards, and have the confidence to express their judgements with conviction. This requires deliberately managed assessment processes and practice that relates to judgements required in professional practice and mature community engagement.

... dialogue and interaction about assessment processes and standards are commonplace between and among staff and students.

Assessment activities and standards require disciplinary and contextual interpretation if they are to be understood, yet discussion of processes and reference points for determining standards is relatively rare. Assessment judgements are more consistent when those making them are able to reach consensus as to ways of establishing levels of performance. Student understanding of processes they can use to judge their own performance are similarly enhanced when they participate in dialogue about them with peers and teachers.

/user/pages/05.blog/assessment-reform/07._culture/4.png

... assessment practices are carefully structured in early stages of courses to ensure students make a successful transition to university study in their chosen field.

For students to become independent and self-managing learners, they need to be supported in the development and acquisition of the skills they need for learning, including those of assessment. Critical to this attainment is early engagement in manageable assessed tasks to build confidence, and the expectation that learning requires not only an investment of effort but also the taking of initiative. This contributes to alleviating anxiety around assessment information, instructions, guidance, and performance. Early assessment provides information to both students and teachers on progress and achievement, and allows for identification of students in need of additional support.

... assessment practices respond to the diverse expectations and experiences of entering students.

Students come to higher education with great diversity in preparedness and understanding of what it involves. To ensure that all can engage equitably with assessment tasks, the implicit rules and expectations around what is required for success in any discipline need to be made accessible to students and opportunities provided for them to develop the academic skills they require to perform those tasks.

/user/pages/05.blog/assessment-reform/08._design/5.png

... assessment design is recognised as an integral part of curriculum planning from the earliest stages of course development.

Assessment is not an ‘add-on’ to the curriculum structure of a program. It needs to be considered from the outset of course design and intimately embedded and linked to considerations of student learning as part of the curriculum. Assessment tasks, types and means of deployment need to be fully aligned with all other aspects of the curriculum.

... assessment is organized holistically across subjects and programs with complementary integrated tasks.

The development of a full range of graduate attributes requires a systematic approach to assessment that builds and enhances those attributes through tasks that are diverse, complementary to each other and embedded strategically throughout a program of study. Integrated whole-of-program curriculum design needs to incorporate assessment and feedback as well as learning outcomes and teaching and learning activities. If carried out in this way, an emphasis on feedback for learning can be the focus of teaching and learning engagement in the early curriculum, leading to capstone and integrated assessment in later years.

/user/pages/05.blog/assessment-reform/09._development/6.png

... professional and scholarly approaches to assessment by academic staff are developed, deployed, recognised and rewarded by institutions.

Academics need particular support in developing expertise required for subject and program assessment responsibilities. Such support could include mentoring, dialogue with peers in informal and formal moderation activities or formal courses. However, while enhanced assessment skills are essential, their acquisition is not sufficient to ensure good assessment practice. Institutions should have explicit requirements that professional and scholarly proficiency in assessment is necessary for satisfactory teaching performance. Further, leadership and exemplary performance in assessment matters should be recognised for promotion, awards and grants.

... assessment practices and the curriculum should be reviewed in the light of graduate and employer perceptions of the preparedness of graduates.

The impact of courses on student learning, and the role of assessment in them, can only be fully evaluated following graduation. Common post-graduation measures (eg. the Course Experience Questionnaire, the Graduate Destinations Survey) presently provide insufficiently detailed information for the improvement of programs. In particular, they do not enable assessment and feedback processes to be sufficiently monitored. Systematic study of the impact of such experiences on graduates (at, say, one and five years from graduation) and employers’ perceptions of such preparation and standards are needed to ensure that courses are effective in the longer term.

... assessment of student achievements is judged against consistent national and international standards that are subject to continuing dialogue, review and justification within disciplinary and professional communities.

The quality of awards in higher education will be increasingly scrutinised nationally and internationally. Assessment practice needs to provide convincing evidence of students’ accomplishments that can be judged against external reference points. Disciplinary and professional communities (both within and beyond the academy) are the focus for ongoing collaboration and dialogue to determine, review and moderate academic achievement standards. Such collaboration and dialogue requires clarity of expectations and persuasive evidence of learning outcomes.

/user/pages/05.blog/assessment-reform/10._inclusive/7.png

... interim assessment results used for feedback on learning and progress do not play a significant role in determining students’ final grades.

For purposes of certification, care must be taken to avoid the formal use of early grades that do not represent the outcomes reached by course or program completion. Entry-level knowledge, learning rates and final achievement levels differ. Although learning itself is cumulative, progressively adding marks throughout the learning period towards the final grade can distort representation of end-of-study achievement. What is important is using interim outcomes to improve learning.

... evidence of overall achievement to determine final grades is based on assessment of integrated learning

Many separate low-value pieces of assessment can fragment learning without providing evidence of how students’ knowledge and skills from a unit of study are interrelated. This is often compounded across subjects, leading students to experience knowledge as disconnected elements. Strong evidence of achievement of the totality of outcomes can be provided by larger-scale tasks that require students to demonstrate coherent integrated learning, not isolated or atomistic performance.

... certification accurately and richly portrays graduates’ and students’ achievements to inform future careers and learning.

An academic transcript that lists subject titles and grades provides limited information to students, employers or educational institutions. Increased scope and sophistication of the reporting of achievement is needed to communicate outcomes well. Two areas for improvement are: veracity, in grades that are fully and robustly aligned with learning outcomes and standards; and, richness, in the documentation of student accomplishments to convey information about what students can and cannot do.

Use and Contributors

Suggestions for use

These propositions can be used to focus debate and action on those features of assessment that have the greatest impact on learning and the quality of courses. They might be most productively used by:

  • planning teams and program directors in new course design and course review and renewal
  • teaching and learning committees and academic boards, institutionally and locally
  • groups of Associate Deans and Directors of Teaching and Learning within and across Faculties
  • those running courses and workshops for academic staff on assessment, and particularly within Graduate Certificates in Teaching and Learning in Higher Education
  • those running leadership programs to ensure that leaders at all levels have a strong appreciation of assessment issues and directions
  • those with academic development roles who consult with staff and course teams
  • those guiding staff-student discussions about the improvement of courses

The challenge is to consider how these might be best pursued within existing cost constraints. This must necessarily involve deciding which assessment tasks should be discontinued in order to provide space for more worthwhile initiatives.

Contributors

David Boud (University of Technology, Sydney), Royce Sadler (Griffith University), Gordon Joughin (University of Wollongong), Richard James (University of Melbourne), Mark Freeman (University of Sydney), Sally Kift (Queensland University of Technology), Filip Dochy (University of Leuven), Dai Hounsell (University of Edinburgh), Margaret Price (Oxford Brookes University), Tom Angelo (La Trobe University), Angela Brew (Macquarie University), Ian Cameron (University of Queensland), Denise Chalmers (University of Western Australia), Paul Hager (University of Technology, Sydney), Kerri-Lee Harris (University of Melbourne), Claire Hughes (University of Queensland), Peter Hutchings (Australian Learning and Teaching Council), Kerri-Lee Krause (Griffith University), Duncan Nulty (Griffith University), Ron Oliver (Edith Cowan University), Jon Yorke (Curtin University), Iouri Belski (RMIT University), Ben Bradley (Charles Sturt University), Simone Buzwell (Swinburne University of Technology), Stuart Campbell (University of Western Sydney), Philip Candy (University of Southern Queensland), Peter Cherry (Central Queensland University), Rick Cummings (Murdoch University), Anne Cummins (Australian Catholic University), Elizabeth Deane (Australian National University), Marcia Devlin (Deakin University), Christine Ewan (Australian Learning and Teaching Council), Paul Gadek (James Cook University), Susan Hamilton (University of Queensland), Margaret Hicks (University of South Australia), Marnie Hughes-Warrington (Monash University), Gail Huon (University of Newcastle), Margot Kearns (University of Notre Dame, Sydney), Don Maconachie (University of the Sunshine Coast), Vi McLean (Queensland University of Technology,) Raoul Mortley (Bond University), Kylie O’Brien (Victoria University), Gary O’Donovan (University of Tasmania), Beverley Oliver (Curtin University), Simon Pyke (University of Adelaide), Heather Smigiel (Flinders University), Janet Taylor (Southern Cross University), Keith Trigwell (University of Sydney), Neil Trivett (University of Ballarat), Graham Webb (University of New England).

Support

Support for this project has been provided by the Australian Learning and Teaching Council, an initiative of the Australian Government Department of Education, Employment and Workplace Relations. The views expressed in this report do not necessarily reflect the views of the Australian Learning and Teaching Council Ltd.

This work is published under the terms of the Creative Commons Attribution- Noncommercial-ShareAlike 2.5 Australia Licence. Under this Licence you are free to copy, distribute, display and perform the work and to make derivative works.

Attribution: You must attribute the work to the original authors and include the following statement:

Support for the original work was provided by the Australian Learning and Teaching Council Ltd, an initiative of the Australian Government Department of Education, Employment and Workplace Relations.

Noncommercial: You may not use this work for commercial purposes.

Share Alike: If you alter, transform, or build on this work, you may distribute the resulting work only under a licence identical to this one.

For any reuse or distribution, you must make clear to others the licence terms of this work. Any of these conditions can be waived if you get permission from the copyright holder.

To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-sa/2.5/au/ or send a letter to Creative Commons, 171 Second St, Suite 300, San Francisco, CA 94105, USA.

Requests and inquiries concerning these rights should be addressed to the Australian Learning and Teaching Council, PO Box 2375, Strawberry Hills NSW 2012 or through the website: http://www.altc.edu.au

For further information contact: David Boud Faculty of Arts and Social Sciences University of Technology, Sydney PO Box 123, Broadway NSW 2007, Australia. David.Boud@uts.edu.au https://www.assessmentfutures.com