Assessment in on-line classes presents significant challenges for both students and teachers, especially for teachers like me who give a lot of importance to evidence gathered throughout the course by performance tasks.
The purpose of framing assessment around performance tasks is to clearly distinguish between those who really understand from those who only seem to because through performance understanding becomes "visible". This is the reason that assessments are frequently designed as projects, which are essentially complex, “messy,” and multi-staged problems to be solved. These critical-thinking elements help teachers see levels of comprehension displayed by students. Tasks with these characteristics also go beyond furnishing a snapshot of student understanding to providing "scrapbook" of understanding - in other words a collection of evidence gathered over time, instead of through a single event. This is crucial because "understanding develops as a result of ongoing inquiry and rethinking". (Wiggins pg. 152)
However, this way of framing assessment still goes against many assumptions our students have about learning and thus about grading as they are often considered equivalent. I have spoken with my students at length about this to understand their perspectives, and they offer a variety of interesting ideas that can be summed up in the following two phrases. Whatever is given a grade by the teacher is important, and anything else can be skipped. Further, grades are derived from quizzes and tests.
Several problems arise from these opposing perspectives to learning that need to be looked at carefully. Among them is how forums are approached. Forums provide opportunities for students to put concepts found in the readings in their own terms and bounce ideas off their fellow students. Groups collaboratively plan a product or performance by facing contextualized issues. These exercises give students feedback and practice at doing the task, both valuable for the summative assessment that will come later in the course.
Fellow teacher and blogger Lisa Lane is particularly concerned about the second point because like me, she wants students to extend their understanding of the topic at hand through discussion in forums.
"In terms of course design, I don’t consider the discussion 20% of the course, just 20% of the grade. It’s more like half the class, because it’s the processing and sharing of the knowledge learned via presentation and reading. It’s the heart, not a side activity. It’s lower stakes (not 50% of the grade) because I want the students to feel free to explore." (Lane, 2009)
This seems simple enough, but my experience corroborates Lisa's - the students just don't get it. The message that students receive is that discussions held in forums are 20% of the class and deserve that much of their energy devoted to the course.
I have found a way to begin to resolve this problem. From the beginning of my courses I make it clear that grades will be based on summative assessment only which will take place at or near the end of the course. All other activities are formative and for that reason are not graded. To avoid misunderstandings regarding the importance of non-graded formative activities, I give a mark to each activity, a number according to its relative value. I keep these on a Google spreadsheet permanently linked to the course so it is always up to date and visible to students. The Google spreadsheet is a link so I never have to upload new versions or save them under new names or send the document out to students because they can see updates made to the document in real time or any time they check into the course.
This has effected a change in student's attitude towards formative activities because students can’t stand to receive a low number, even if it doesn’t count towards the grade. I have told them that because activities are formative, they can be improved by going over my qualitative feedback and the rubrics. This of course means being flexible with due dates and very patient with problems students and groups have in submitting assignments on time. It has motivated them to interact more with me, with classmates and with the rubrics and it has focused their attention, even if it is inadvertently, on the learning process - writing, editing, consulting, re-writing, re-editing, consulting again - and less on the grade itself.
Also, if a discussion is designed to last two weeks and it is worth six points (marks), I assign three to the first week and three to the second week. This gets students to participate more constantly and not just at the end of the designated period for that discussion.
Students can compare the number of marks they have to the total possible number at any given moment which serves as an alert for students who fall behind. At the end of the course, they are awarded a Professional Development score, which is simply the sum total of their marks. This indicates effort given towards the activities in the course and their level of mastery of the key course concepts. In nearly every case high marks coincide with high grades and low marks with low grades. Although this score is not part of the grade, students take it as seriously as the grades.
Although it may be counterintuitive to use numbers (marks) to encourage students to practice essential skills, it seems to be a language symbol that communicates a message far clearer than many of my attempts to explain and motivate.
---- References ----
Lane, Lisa. Ramblings on Assessments that work and assumptions that don't. Blog post, 2009. http://lisahistory.net/wordpress/ ?p=392
Wiggins, Grant and McTighe, Jay. Understanding by Design. Association for Supervision and Curriculum Development, 2005. pg. 152.
Article originally published in Online Classroom, August 2010.
