learning (27)

Does AFL lead to grade inflation?

A criticism of Assessment FOR Learning is that along with it comes pressure to make sure that students’ grades increase. In other words, some have been concernerd that AFL might lead to grade inflation. I would hope that no school would ever encourage grade inflation while it encourages its teachers to try AFL techniques. I think that that the concern over grade inflation is probably first and foremost a misunderstanding about the purpose of AFL. The primary goal of AFL is not grade inflation. I don’t know that it would ever be appropriate for educators to do things solely for the purpose of raising grades. In fact, if grade inflation was the goal then a focus on AFL wouldn’t be necessary. Many teachers already do an excellent job of grade inflation through several more traditional measures such as extra credit, dropping the lowest grade, or curving scores. These are practices that teachers have used for many years, and they all have the same outcome of inflating grades and making grades less representative of actual learning. AFL isn’t necessary for inflating grades. The primary goal of AFL is instead LEARNING INFLATION. The entire purpose of AFL is to increase learning. When teachers assess students in an ongoing manner, use that data to guide their instructional practices, and teach students how to use their own assessment data to chart their progress and to guide their studies, then it is only natural that learning will increase. Now let’s be honest, when learning increases grades tend to increase as well. That is, grades will increase if we are grading accurately while learning increases. This is why it is impossible to discuss assessing with AFL techniques without also discussing grading practices. While assessment is not the same as grading, and while not all assessments need to be graded, if teachers aren’t careful with their grading practices they can negate their assessment efforts. For example, if a teacher’s assessment practices cause a student to increase learning to a B level but the grading practices cause the student to earn a D then the incentive for learning will decrease. Once the conversation moves to grading practices it is very easy for that subject to dominate the discussion, but don’t be fooled – grading is secondary to learning. As you make plans to use AFL in your classroom, focus on this simple mantra: AFL is about how you use assessments to increase learning. Whatever types of assessments you use, use them in ongoing manner, use the data you receive to guide your instruction, and train/require your students to use their own data to guide their studies. You’ll be using AFL and learning will inflate.
Read more…
Members of this network may have noticed a video that seems out of place on an educational social network. The video is of a post-game interview with NBA player Allen Iverson. Why in the world is that on here?

Salem High School teachers on this Ning know the answer to that. When our school first started taking a serious look at AFL, we realized right away that how you chose to grade assessments could negate the learning that they generated. In other words, if you use AFL strategies well they will lead to an increase in learning. Students and teachers will be using feedback to guide learning and instruction. However, if we want the student's grade to reflect the learning that occurred, we must be very careful and deliberate about how we grade (or don't grade) the assessments we give. Allen Iverson - believe it or not - has something to say about that. Watch the video and then I'll explain.

(If the video on this post didn't load right away, try reloading the page.)


It's been awhile since I've seen that video. Could someone refresh my memory about what he was "talkin' 'bout"? Oh, that's right - PRACTICE!

First of all, my posting this video is not in ANY WAY making a point about the need to practice when you're on a team. I'm not AT ALL an Iverson fan. It's just posted because it gives us an image to which we can relate - We're Talkin' 'Bout Practice!

How does this relate to grading? Think about your grades and your assessments. How many of them are "practice"? In other words, how many of your assignments are intended to help students practice so that they can learn? I bet you that most of them are. Now let's think about grading. How many points to you assign to these assignments? What would happen to a student who mastered the content, as evidenced by your final graded assessment, but did poorly on the practice assignments?

Let's get more direct: How many students are failing your class because they either didn't do or did poorly on your practice assessments? Do you have students who can pass your tests - or whatever your final graded assessment is - but fail your class? Why is this? It's because their practice assignments - the ones that were supposed to help them learn - are counting against them. Never mind that they mastered the material - or at least learned it to a level above failing. Never mind that you taught them even though they didn't do all your assignments. Their practice is causing them to fail.

By the way - I'm not saying here that practice isn't important. I think students should practice everyday in class and every night at home. But should practice be graded in a way that allows a kid who learned the content to fail the class or receive a grade that does not represent learning?

The Winter Olympics just ended. Some gold medals were won by less than 1/10 of second. What if the practice runs were then averaged in causing the gold medal winner to get a silver? That would be ridiculous. Our goal is to get kids to be able to learn and perform. If they do this then it's because of the job we did. Why would we then take a bunch of practice assessments and average them in with the assessments that really counted?

If we use AFL to increase learning but then grade poorly, we can end up negating the achievement. Take a look at your grade book. Examine why some students are failing. Remember - WE'RE TALKIN' 'BOUT PRACTICE!
Read more…

AFL Presentation at VASSP Conference

If any members of this Ning are going to be attending the Virginia Association of Secondary School Principals annual conference this week in Williamsburg, I would invite you to attend my presentation on The Heart of AFL.  It will be on Tuesday, June 28 from 1:30-2:30 and will repeat from 2:45-3:45.  Here is a link to the handout for that presentation.

 

Hope to see some of you there!

Read more…
I would imagine that many Physical Education teachers must feel as though much of the professional development activities and workshops in schools do not apply to them. Typically, discussions of state standards and NCLB expectations dominate these discussions. While these apply to PE, they apply in a different manner than they do in a core area classroom. And let’s face it, PE is a very different world from the typical classroom. PE teachers are dealing with a completely different environment than most other teachers. They are dealing with a different set of behavior issues, a different set of classroom expectations/procedures, and a different set of skills than other teachers are. One reason that I have become a big fan of Assessment FOR Learning is the fact AFL principles are universal. Even though a PE classroom differs greatly from a regular classroom, AFL ideas still apply and can still help students learn in such a setting. I have spoken with PE teachers who can see how AFL could be used in teaching and assessing certain skills in PE – such as foul shooting (I’ll share such an example in a moment). Along with AFL comes the importance of accurate grading practices – grading that reflects mastery of content and skills. However, the trend in PE these days is to move away from grading based on the mastery of skill acquisition in favor of participation and effort. Therefore, one could conclude that AFL would not be appropriate to use in the PE environment. The trick is to separate assessment from grading. The purpose of AFL is to assess in a way that helps students learn. The purpose is not to assess to get a grade. While a grade may be an outcome, it is not the primary goal. Therefore, one can assess a student (create feedback that can be used to guide learning) and still not grade based on those assessments. Let me explain. I regularly work out in our school’s weight room. When the football players are there lifting weights, they each carry around a piece of paper with a chart on it. They use this chart to keep track of their lifting. They each have goals that they would like to reach for various lifts. The coaches let them know how much they should be lifting each week if they are going to reach their goals by “max out” day. The players make sure that their progress is matching the path that leads to their goal. While perhaps no one has called it this before, I think that the weight lifters are participating in an AFL activity. They are part of a “planned process in which assessment-elicited evidence of students’ status is used by… students to adjust their current learning tactics.” (James Popham) They are taking ownership of their progress. They are aware of what they need to do to achieve a goal, they are constantly assessing how they are doing, and they are adjusting their lifting patterns to make sure they reach the goal. No one is grading them based on how much they lift. However, because of the feedback they are receiving and the way they have been trained to use that feedback they are getting stronger and stronger This is an example of how AFL can be used to teach an athletic skill. So let’s say that the skill being taught is shooting foul shots in a PE class. The students could take a pre-assessment by shooting 10 foul shots. They could then set a goal for improvement. Then the teacher could demonstrate/teach/instruct the students on the various sub-skills necessary to shoot a foul shot – proper foot placement, bending knees, holding the ball properly, where to aim, arm extension, wrist/hand motion, ball rotation, arc of the ball, and follow through. Students could learn a sub-skill, practice it, assess how well they are able to use the skill, and chart the impact that it has on their foul shooting as they repeatedly apply their new skills to the act of shooting 10 foul shots. They could work to assess/critique each other as well. As someone who has never taught PE, I’m sure that the model I just described has some flaws. I’m sure it could be tweaked to be made more practical for a PE setting. However, it is an example of AFL. AFL isn’t always teachers using assessment data. In fact, AFL is probably at its most powerful when students are using the data themselves to guide their own learning. In a skill-based class like PE this is definitely possible. Now, here’s the kicker: the result of the self-assessment – in other words, how well the student can shoot a foul shot when the unit is finished – does not have to have any impact whatsoever on the student’s grade. Instead, the grade the student earns could come from how diligently the student completed the self-assessment process. A daily grade could be earned based on how completely the chart was filled out each day. A final unit grade could be assigned based on the completed chart. This would be a more objective way to grade than a perceived level of participation or simply dressing out. It would be an accurate grade of effort and achievable for all students. (Of course, I realize that does not mean all students will decide to achieve a good grade.) But again, the point is that the Assessment FOR Learning practices are there to help the student learn the skill, and the grade does not have to be based on the mastery of the skill. Assessing and grading are two very different things. Assessment in AFL is all about getting students to learn.
Read more…

AFL and Learning to Drive

Have you ever watched a teenager prepare for the DMV Learner's Permit test? If you have, then you'll know what I mean when I say that it is an excellent example of Assessment FOR Learning.

(As an aside, I'm having a hard time coming to grips with the fact that my oldest child is now learning to drive a car. Kaitlin is everything I could ask for in a daughter with one exception - she has moved beyond the age of 8!)

The Virginia Department of Motor Vehicles has what amounts to an online textbook. They also have online practice tests. Kaitlin began by studying the materials online and then quickly moved to the online practice tests. As soon as she finished each practice test she was immediately given her score. In the week leading up to her DMV visit, she must have taken 100 practice tests - each one slightly different than the one before. The big day finally arrived and her mother took her to the DMV where she passed her actual Learner's Permit test with a score of 100%. On the one hand I was proud of her, but on the other hand I was wishing she had failed so that I would have had a good excuse to not let her drive!

I hope that all readers of this are familiar enough with AFL to see right away the "AFL-ishness" of this example. I'll go ahead, though and highlight a few key points:

1. After each assessment (the online practice tests) Kaitlin received immediate descriptive feedback. This descriptive feedback from the teacher (the website in this case) was given for the purpose of helping her learn for the next attempt rather than simply describe what her grade was.

2. Kaitlin used the assessment-elicited feedback to alter/guide her learning. Over time (remember she took about 100 tests) she began to realize her strengths and weaknesses. This enabled her to study the online material more purposefully and, therefore, to learn better.

3. The more she was tested, the more she learned. This relates back to a recent post on this site called Test 'em more. That blog post referenced a study that was detailed in the NY Times. That study found that the act of taking a test - of being assessed - actually led to more learning. Therefore, many assessments/tests are better than fewer.

4. Finally, the end result, the grade that comes from the eventual summative assessment (the one taken at the DMV) truly reflected Kaitlin's level of mastery. The practice was not counted against her. The practice was important. In fact, it was essential. But in the end, it was just practice. Learning was what mattered most. Kaitlin passed with a 100%.

Now comes the fun part - I ACTUALLY NEED TO LET HER DRIVE ON THE ROAD!
Read more…
I plan to create a series of posts that will help teachers better understand AFL so that they can apply AFL ideas into their classrooms. One way to do this is to define what AFL isn’t. AFL isn’t replacing quiz grades with test grades. However, replacing quiz grades with test grades could be AFL – does that make sense? Here’s what I mean: When a good AFL idea is shared with a faculty it is very easy for people to begin to see that idea as a definition of AFL instead of one example of how AFL ideas can be applied. With my own faculty at SHS and on this site I have recently shared an excellent example of how a teacher at SHS (or as it turns out, the majority of the SHS Math Department) is letting sections of unit tests replace grades earned on previous quizzes that correspond with that section of the test. (For more on that click here.) After a meeting with our school’s AFL committee I realized that based on that post and on other discussions we have had as a faculty, it would be easy to assume that our school was expecting teachers to apply AFL in this manner. In fact, it could be easy to assume that this example was what AFL was all about. Such an assumption would be wrong. Not all classes assess in the same manner. Therefore, if this one example was AFL then AFL could not apply to all classes. The beauty of this example is that for this teacher, or these teachers, it is a way for their assessments to be used in an AFL manner. Before going any further, let’s look at a definition for AFL: AFL is a planned process in which assessment-elicited evidence of students’ status is used by teachers to adjust their ongoing instructional procedures or by students to adjust their current learning tactics. (James Popham) Also, let’s remember something that has been stated repeatedly at Salem High School regarding AFL: AFL is about how the results of the assessments will be used – not what the assessments are. The example shared in my previous post is an example of AFL practices being put into place because it is an example of a process in which assessment-elicited evidence of students’ status is used by students to adjust their current learning tactics. The types of assessments being used – essentially traditional quizzes and tests – are nothing new or groundbreaking. What is exciting – what makes this an AFL example – is HOW these traditional assessments are being used. Typically, when quizzes and tests are given they serve as a series of summative assessments. While in theory a student should use the results of the quizzes to study for the test – and many students have done just that – there is not a great incentive to do so. Even if the student improves on the test the quiz is still averaged into the grade. While we would like to think that the student would see the quiz as a learning experience, in many cases the quiz is viewed as simply another grade in the series of grades that determines the final average. However, when the math teachers at SHS explain to their students that the test will be an opportunity to not only show that they have learned but also to change a previous low grade, the incentive to study for the test has been increased. As a parent I saw this occur this very morning when my daughter, who normally does not like to go into a classroom before school for extra help, went to her math teacher on her own volition this morning to get help. Kaitlin knows that she has an opportunity to raise her grade and is, therefore, working harder than normal. And with hard work comes learning. Don’t be confused about the grade part either – AFL isn’t about making sure that a student receives a high grade. AFL is about making sure that a student learns. Of course, a higher grade will probably come as a result (unless the teacher’s grading practices are flawed), but the grade is secondary to learning. The beauty of the way the SHS math teachers are operating is that they are putting assessment data into the hands of students and then providing them with an incentive to use that data to change their learning tactics. That is why this is an AFL technique – because assessment is being used to encourage learning instead of being used primarily to create a grade. Does that mean that all teachers must use this same strategy in order to be using AFL ideas? Of course not. What teachers need to do is to look at the assessments they are currently using and determine how the data that comes from them can be used by students or teachers (and it’s most powerful when it’s used by students) to enhance learning. In future posts I will share some more ideas of how this can be done. But for now, remember: You don’t have to come up with new assessments to use AFL. Instead, you need to make sure that your assessments are used more to guide learning than to simply create a grade.
Read more…

6 Key AFL Ideas

The 2008-2009 school year was my school and school system's first year exploring Assessment FOR Learning/Formative Assessment. It was definitely a learning year for all of us.

Over the summer of 2009 I spent some time thinking back on what I had learned about AFL during the year. I thought about conversations that had occurred on our school's AFL Committee. I thought about time spent with individual teachers as we worked together to implement AFL practices into their classroom. I thought about articles and books I had read, videos I had watched, and many other AFL-related staff development opportunities in which I had participated.

The result was that I entered the 2009-2010 school year with a much greater appreciation for AFL. I had come to see how all-encompassing it really was - how it could truly impact our entire approach to instruction. I also realized that it was very easy to have misconceptions of exactly what AFL is all about.

All of that led to what I call my 6 Key AFL Ideas. When one understands and can apply these 6 ideas, AFL will have a positive impact on instruction and learning. However, when any of these ideas are missing or not understood, it seems to me that AFL loses its effectiveness or perhaps isn't even present.

6 Key AFL Ideas
1. Assessment and grading are not the same thing.
2. There aren’t AFL assignments and non-AFL assignments.
3. AFL provides a framework or reason for why we do what we do.
4. Assessment for LEARNING as opposed to Assessment for GRADING.
5. We learn from our mistakes.
6. Students need to know what they need to know so they can know if they know it.

Now let me explain in a little more detail what each of these ideas means:

1. Assessment and grading are not the same thing.
Try not to get into your mind that AFL means changing or altering the way you grade. AFL means assessing to help students learn. This can be done without grading. However, if you don’t grade well you can negate your AFL efforts. In other words, if you use all sorts of assessments to provide feedback to students and as a result your students learn, but then you grade in a way that causes their grades to not be reflective of their learning, then the AFL was negated by the grading practice. While assessment and grading are not the same thing, you must be willing to grow as needed in your grading practices as you grow in your assessment practices. But remember - when one speaks of assessing students it doesn't have to mean grading students.

2. There aren’t AFL assignments and non-AFL assignments.
AFL is HOW you USE assignments, not what assignments you use. Something has an AFL purpose if you
and/or the students use the feedback to further learning. All assessments can be used for an AFL purpose. AFL doesn't mean you will have to completely change the types of assessments you use. What it means is that you will be very cognizant of how frequently you assess so that you can provide very regular feedback to students.

3. AFL provides a framework or reason for why we do what we do.
AFL is a philosophy. When we attach a name or meaning to what we do, we are more likely to do it. A lot of people hear about an AFL strategy and say, "I already do that." But here's the thing - why do you do that? Education is not an exact science. Many of us stumble on certain activities or procedures that work. But do we understand why they work? If we have a governing philosophy for WHY we do things, then we are more likely to continue and even increase our doing them. Instead of doing something because we've always done it, we instead do it because it falls into our governing philosophy. This will most likely lead to that practice being enhanced and more practices like it being added to our toolbox.

4. Assessment for LEARNING as opposed to Assessment for GRADING.
Don’t be afraid to assess and not grade. Think of other ways to give feedback besides a traditional grade. Don’t get locked into the idea that you must average all feedback in order to determine a grade. Just because you give some sort of feedback doesn't mean the "grade" has to count into the whole. That is a box that educators find themselves in too often. It results in us grading student practice too much. The student ends up learning because of our teaching, but then gets a grade lower than their learning because of our grading. Assess for the purpose of learning.

5. We learn from our mistakes.
When a student makes a mistake in your classroom (does poorly on an assignment) can that mistake be used
for instruction and learning? Or does it always inherently lead to a lower grade and, therefore, discourage
learning? We all know that in life we usually learn the most from our mistakes. Too often in education students don't have the chance to demonstrate that or to erase their mistake. If students realize that they can learn from mistakes and then fix them then they will be more likely to take chances.

6. Students need to know what they need to know so they can know if they know it.
I have come to view this idea as perhaps AFL at its most potent form. If we use AFL properly we can empower students to take control of their learning. If students are regularly - preferable daily - given assessment feedback and then taught how to use it, they are more likely to grow into the types of learners we want them to be. They will gain skills that will carry them beyond us and into future learning experiences. Consider using rubrics on a regular basis. Let your students know your thoughts on AFL. Explicitly describe why you are assessing and doing what you do. Encourage/teach/require them to assess themselves.


I hope those 6 ideas make sense and that they help you out as you try to apply AFL to your classroom. Let me know if you have any questions or thoughts.
Read more…

Blog Topics by Tags

Monthly Archives