Tag Archives: formative assessment

Feedback to maximise student progress and minimise teacher workload

Posted on by
2
Source: pixabay @Darkmoon_Art

Giving meaningful feedback to students is a key lever for improving student progress, and also a primary draw on teacher time. On the latest episode of my podcast, The Edu Salon, I discuss feedback with Professor Dylan Wiliam, including what feedback is most likely to be effective for student learning, and how feedback practices can address issues of teacher workload. Dylan reminds us that feedback is not to improve the work, but to improve the learner. It should not be a post-mortem dissection of past work, but rather provide understandable information about, and incite action towards, how to improve next time. For feedback to be effective, the student needs to engage with it, reflect on it, seek to understand it, and act on it.

Teachers employ a range of feedback strategies such as: marking and annotating student work; whole-class feedback through markers’ reports unpacking trends and patterns; marking keys showing what correct or good answers include; rubrics that describe what students can do and the next level of achievement; exemplars of student work to illustrate what good responses looks like; and videos of student practical or performed work for students to reflect upon. Teachers work towards provision and processes of feedback that allow students to do the thinking around feedback, rather than merely emotively reacting to a mark. This might be by protecting time for students to process and act on feedback, withholding marks until the student has acted on feedback, or providing opportunities for students to re-do tasks.

This week, I returned the marked mid-year examination to my Year 12 Literature class. This is a deliberately slow and intentional process that takes at least one lesson. First, I explain to students that what I am least interested in is the mark they received, and what I am most interested in is what they can learn in order to make improvements between now and their next exam. Then, the students receive the written reflection proforma, exam paper, and markers’ report (outlining the marking key and the whole-cohort feedback). Then, students reflect in writing about what they learned through their experience of revising, preparing for, and sitting the exam. For instance, was the exam paper what they expected? Were they adequately prepared? Were they familiar with the terminology and concepts of the questions? Did their exam strategy and time management work well, or would these benefit from adjustments? Next, students receive their annotated papers and build on their reflection. What were their strengths? On what could they improve? What could they do and what will they do between now and the next exam?

Once students have reflected as much as possible, shown me their reflection, and we have had a one-on-one conversation about their learnings and planned actions, they receive the rubrics that include their marks, as well as indicating where they went well and less well in addressing the criteria. They then complete their written reflection and upload a summary of what they did well, and what action they will take to improve. In the lessons following (and/or between lessons at other scheduled times), I make time to speak to each individual student about their understanding of the feedback, what they have done well, and how to best invest their time to improve. Students often re-write their least successful response, or set a plan for practising responses to questions and revising content.

Giving feedback, as important as it is, should be manageable for the teacher. In Western Australia, the curriculum authority is moving towards a rule of no more than eight assessments across the year (including examinations) for Year 11 and 12 courses. The move to fewer summative assessments is encouraging teachers to assess less, find alternate ways of gauging student understanding, and teach explicit revision strategies to support students being assessed on multiple topics studied over time, rather than topic by topic as they are taught and learned. (Also listen to the podcast episode for discussion of how to leverage students’ cognitive architecture to make the most of long term and working memory.) A bonus is that teachers and students feel less like they are hurtling from assessment to assessment, and more like time is spent learning, revisiting, and reflecting.

Fewer assessments for students to complete means fewer assessments to mark, and potentially more time for students to engage with feedback. Spending time on students working to understand feedback is crucial for student progress and also means that all the hard work teachers put into providing feedback is understood and utilised by the learner. In the podcast episode, Dylan discusses his suggestion that teachers do ‘four quarters marking’: about 25% marking in detail, 25% skim marking to inform teaching, 25% teacher-monitored student self-assessment, and 25% peer assessment. (You can read more about this approach in Carl Hendrick and Robin MacPherson’s 2019 book What Does This Look Like in the Classroom?) This is likely to be an approach that challenges traditional practices and expectations of students, parents, teachers, and school leaders. It is, however, a provocation that reminds us to consider how our feedback practices engage the student as self-regulated learner committed to continuous improvement. As Dylan says in the podcast episode: “Good feedback works towards its own redundancy.”

Teacher workload vs. student learning

Posted on by
3

As teachers, our jobs are about supporting students in their learning and development. Teachers are constantly in service of their students, their students’ families, and their school community. But we are also human beings who have bodies, families, and relationships.

On Friday I missed my self-imposed weekly blogging deadline because I was up past my eyeballs in English exam papers. As I marked, I was wrestling with a dilemma: increasing my marking  workload with a view to student learning, or protecting my wellbeing by streamlining the marking process.

When you have 120 papers to mark in a short time, the easiest way to do that is to put a mark only on each paper, and publish a markers’ report that synthesises comments and feedback to the group. The long, hard way to do it is to annotate and write a comment on every paper. My dilemma was that, while a marker’s report is useful for students, I believe that annotations and comments on papers will help students to understand why they got the mark they did and how to improve for next time. That annotating and commenting on every paper takes much longer and results in more time and more pressure, while taking time away from other work streams and from my family. The other nagging feeling I had was that many students may not engage with the comments I was taking so long to formulate, making the whole lengthy exercise a waste of time. My experience with handing back exam papers, however, tells me that students can’t often make the connections between their work and a marker’s report; the annotations and comments can help them make sense of where they can improve.

In the end, I couldn’t stop myself from annotating and commenting. I decided to carve out more time (day, evening, and weekend) so that I could provide students with information they could use to help them do better next time. Students will have a number of assessments, plus their end of year exams and their tertiary entrance exams, still to come. As a teacher, I couldn’t pass up the opportunity to do what I hoped would be helpful for students in preparing them for the learning that comes next.

But it has meant that I’ve spent less time with my kids, less time looking after myself (I tend to find less time to make meals for myself and to exercise while under a heavy marking deadline), my neck has seized up (probably thanks to hours spent cocking my head as I read and write on papers), and have come down with a cold (it’s winter here so perhaps that is coincidence rather than evidence of compromised immunity).

While exams are a summative assessment, when my students receive their exams back, they will be led through a formative process of reflection, action, conferencing with me, and target setting. This process is based on the UK’s Assessment Reform Group’s summary of the characteristics of assessment that promotes learning. According to the ARG, assessment that promotes learning:

  • is embedded in a view of teaching and learning of which it is an essential part;
  • involves sharing learning goals with students;
  • aims to help students to know and to recognise the standards they are aiming for;
  • involves students in self-assessment;
  • provides feedback which leads to students recognising their next steps and how to take them;
  • is underpinned by confidence that every student can improve; and
  • involves both teacher and students reviewing and reflecting on assessment data.

Student engagement with their own work, its feedback, the marker’s report, and subsequent setting of next steps and how to take them, can help summative assessments like exams become learning opportunities. My students will be required to act on the feedback, as recommended by much feedback literature. My annotations and comments on students’ papers will form part of this process of engagement, reflection, and action.

As teachers, we often find it impossible to compromise our desire to help students, even if it means sacrificing our own time and wellbeing to do so. It’s why we need to make good decisions about where to expend our efforts. We also need to carve out time for self-care when we can, and find ways to nourish ourselves during the peaks of our workload. I’m looking forward to an overseas family holiday in the next holidays!

Is formative assessment overvalued?

Posted on by
5

Call me late to the party, but last night I was surprised to see this tweet from Alfie Kohn stating that formative assessment is overvalued. I agree with his latter comment that data to see if students are improving, or have improved, are worthless until we’ve asked ‘improved at what?’, but I don’t understand the connection between the two parts of the tweet. My hunch is that my understanding of formative assessment in practice is different to Kohn’s. In this post I’ll explain my own take on formative assessment.

(Disclaimer – I understand that a tweet is limited in its 140 character form. I’m using my understanding of the tweet as a jumping off point for this post.)

From the seminal 1998 paper of Paul Black and Dylan Wiliam, ‘Inside the black box’, to subsequent work by these authors, and others, formative assessment as an evidence-based, rigorous feedback process is well-established.

Feedback can be defined as information provided by an agent regarding aspects of performance or understanding (Hattie & Timperley, 2007). Wiliam (2016) notes that anyone (teacher, learner, peer, parent) can be an agent of feedback, and that the most powerful agent of feedback is likely to be the student who takes responsibility for their own learning.

The purpose of feedback, according to Hattie and Timperley (2007) is to reduce the discrepancy between current and desired understanding. Information is used by students or teachers for improvement in an interactive dialogue between teacher and learners so that learners can become more expert and more responsible in guiding and furthering their own learning (Black & Wiliam, 2010). The interactivity, and the activity, are important. Teachers use feedback to make adjustments to planning and instruction. Students become active, empowered agents of their own learning as they self-assess, receive feedback, and act on it. Formative assessment is based in a belief that every learner can improve.

Feedback can have a significant positive influence on student learning and achievement (Stiggins & DuFour, 2009; Wiliam, 2011a, 2011b, 2016), but it is linked to emotions, relationships and environment; it can be accepted, modified, or rejected; and it can have positive or negative effects on performance (see Kluger & DeNisi, 1996).

Formative assessment involves feedback that is continuous; specific to goal, standards and task; descriptive rather than numerical or via grades; occuring within a learning context; and acted on by the learner (such as through self-assessment, re-doing the task, or outlining next steps).

It is information and interpretations from assessments, not numbers or grades, that matter (Hattie & Timperley, 2007). Numerical marks and grades operate as judgements, not aids to learning, and so students ignore comments where a mark is provided (Black, 2014; Black et al., 2004). Alfie Kohn argues against grades in this 2011 paper. Ruth Butler (1987, 1988) found that grades had no effect on achievement. Written comments based on the task, on the other hand, resulted in high levels of task involvement. Comments should identify what has been done well and what still needs improvement, and give guidance on how to make that improvement (Black et al., 2004; Wiliam, 2011b).

Feedback should not involve judgement of the person, positively or negatively. Butler’s research (1987, 1988) found that written praise had no effect on achievement, and Costa and Garmston (2003) note that learning cannot occur if a person feels threatened. While receiving feedback can be emotional, it should be designed to evoke cognition over emotion.

At a grass-roots level, teachers such as Starr Sackstein (2015, 2017) and Mark Barnes (2013, 2015) have been advocating for teachers to ‘throw out grades’, focusing instead on feedback practices such as conferencing, peer assessment, and self-assessment.

This previous blog post outlines some of my own practices around summative assessments, as well as a term I spent teaching Year 10 English without any marks or grades. I have recently developed my summative assessment feedback practices to ensure that students engage with their work more deeply before it is assessed, and then again once I have written comments, but before receiving their mark. In my classroom, formative assessment practices are a constant. They include myself and my students constantly engaging with their work, curriculum standards, syllabus points, rubrics, clear criteria for success, and setting of specific targets. These practices are entwined within a relational classroom environment of trust and challenge. Anecdotally, some of the best a-ha moments for my students come when they assess their own work against clear criteria, and come to their own realisations about how to improve. Over time, self-assessment becomes part of expected and lived practice for students in my classroom. This is not to say that I am a formative assessment expert; building formative opportunities takes ongoing teacher reflection, deliberate planning, and careful constant reading of the students.

Perhaps I have been embedding formative feedback practices into my teaching for so long that it seems obvious, but my thought on first seeing Kohn’s tweet was: of course we cannot look at data that might indicate improvement of learning without asking ‘improvement at what?’ Specific goals, standards, and comments on how and on what to improve, are part and parcel of the suite of practices of formative assessment.

Is formative assessment overvalued? I don’t think so. It is a fundamental way to improve learning, and also to build the capacity of the learner themselves.

References

Barnes, M. (2013) Role reversal: Achieving uncommonly excellent results in the student-centred classroom. Alexandria, VA: ASCD.

Barnes, M. (2015). Assessment 3.0: Throw Out Your Grade Book and Inspire Learning. Thousand Oaks, CA: Corwin.

Black, P. J. (2014). Assessment and the aims of the curriculum: An explorer’s journey. Prospects, 44, 487-501.

Black, P., Harrison, C., Lee, C., Marshall, B., & Wiliam, D. (2004). Working inside the black box: Assessment for learning in the classroom. Phi Delta Kappan, 86(1), 8-21.

Black, P. J., & Wiliam, D. (1998). Inside the Black Box: Raising standards through classroom assessment. Phi Delta Kappan, 80, 139-48.

Black, P. J., & Wiliam, D. (2010). A pleasant surprise. Phi Delta Kappan, 92(1), 47.

Butler, R. (1987). Task-involving and ego-involving properties of evaluation: Effects of different feedback conditions on motivational perceptions, interest, and performance. Journal of educational psychology, 79(4), 474-482.

Butler, R. (1988). Enhancing and undermining intrinsic motivation: The effects of task‐involving and ego‐involving evaluation on interest and performance. British journal of educational psychology, 58(1), 1-14.

Costa, A. L., & Garmston, R. J. (2003). Cognitive coaching in retrospect: Why it persists.

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research 77(1), 81-112.

Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory.

Kohn, A. (2011). The case against grades. Educational Leadership, 69(3), 28-33.

Sackstein, S. (2015). Hacking assessment: 10 ways to go gradeless in a traditional grade school. Cleveland, OH: Hack Learning.

Sackstein, S. (2017). Peer Feedback in the classroom: Empowering students to be experts. Alexandria, VA: ASCD.

Stiggins, R., & DuFour, R. (2009). Maximizing the power of formative assessments. Phi Delta Kappan, 90(9), 640-644.

Wiliam, D. (2011a). Embedded Formative Assessment. Bloomington, IN: Solution Tree.

Wiliam, D. (2011b) What is assessment for learning? Studies in Educational Evaluation, 37(1), 3-14.

Wiliam, D. (2016). Leadership for teacher learning: Creating a culture where all teachers improve so that all students succeed. Moorabbin, Australia: Hawker Brownlow Education.