The how of standardized tests

Yesterday over donuts and coffee, I had the beginnings of an interesting conversation with a colleague. Our juniors are scheduled to take the Smarter Balanced Assessments (SBAC) at the end of this week, and it has been the source of a great deal of controversy over the past few months. MANY of the students are opting out, our federal funding is still officially at stake, there is a flurry of legislation pending in the state legislature, and there are very strong opinions on all sides.

I say it was the beginnings of an interesting conversation, precisely because of those strong opinions.  Since our school is required to give the tests, and since the students not opting out of the test will invest significant energy in doing well, I feel strongly that we should do our best as a school to get real, usable data.  To do otherwise means our results are essentially useless to us, even as a baseline for future testing.

My colleague feels (just as strongly) that the SBAC assessments are (1) damaging to kids because they test things the kids have not been taught in our current curriculum, and (2) part of an unethical, profit-driven cycle that we should disrupt in every legal way possible, including by opting our own children out of the testing and encouraging others to do the same.

Strong opinions can lead to strong reactions.  But as my neighbor the Zen priest says, “Just because you see the bus going by, that doesn’t mean you have to jump on and ride it wherever it is going.” In other words, don’t react without thinking.  Listen first, then consider, and then respond. Both my colleague and I did a good job on the surface; we appeared to listen thoughtfully to each other and discuss our disagreements like grownups.  (At least my colleague did, and I hope I did, too.)

But on my side, the key phrase is “appeared to,” and I know that part of that appearance was an act. Granted, I wasn’t just responding by reflex. I was thinking carefully before I spoke, largely because I really respect my colleague and didn’t want to offend her.  But mostly I was thinking, “How can I express myself really clearly so it’s obvious that I am correct on this?”  I was granting the validity of her arguments, but not really trying to put myself in the position of understanding and supporting her opinions.  I know that it’s intellectually lazy of me to disagree with someones opinions unless I’ve made that effort.  It also deprives me of some really interesting ideas.

So, with apologies to my colleague for not doing this in the moment, here I go.

Argument one against SBAC testing: It damages children to test them on content they don’t know.

I do believe that many, maybe most of our students are upset when they face test questions they can’t immediately see how to answer. Some of them are demoralized; they see it as confirmation that they aren’t good at the subject. Others get angry that they are being unfairly assessed on content they haven’t been taught.  But whose fault is that?  I think it is something we as educators have brought on ourselves, by never presenting kids with test questions that they shouldn’t immediately know how to answer. We scaffold the heck out of everything.  We try  to teach each student in Vygotsky’s zone of proximal development, but we take great care never to test them there.  We train students that we hope for them to get every answer correct, and we are disappointed when they don’t. We make fixed grading scales that penalize the students when the teacher writes a question they can’t wrap their heads around yet.  As a result, neither the teachers nor the students ever really find out what they can do.

This is poor preparation both for college and for life.  Both places are chock-a-block full of questions we don’t know how to approach.  Often our half-formed answers and attempts at answers have really important consequences.  We should be preparing for our entire lives to climb all sorts of challenging cliffs, hoping to find a hand- or toe-hold that will let us get up to the next ledge.  It should be fun and invigorating to do this.  As teachers, we need to prepare our kids in such a way that the majority of them get the chance to respond to challenges in this way, rubbing their hands together in anticipation. So how do we go about it?

My colleague is right.  We don’t do it by throwing a test like this at them for the first time when they are juniors in high school.  We don’t do it by throwing it at them once a year at “standardized testing time.”  But I’m right, too.  We really need to do it somehow, and we need a measure that shows we aren’t doing it now.

Argument two against SBAC testing: it is part of an unethical, profit-driven cycle that we should disrupt in every legal way possible.

I definitely agree that standardized testing has become way too profit-driven, and that a whole exploitative industry has grown up around our quest for data about our students.  I’m not sure how we should respond as teachers. I think it is really important not only to assess our students on what we have taught them, but also to know how their learning (and our teaching) compares to that in the rest of the world.  Any attempt to measure such a broad question is going to be imperfect, but that doesn’t mean the measurement isn’t important.

A bigger question is how to keep profit and exploitation out of the equation.  Is it even possible in our system? In an education system where every state and sometimes every local school district has a different curriculum, whom can we trust to come up with standardized measurement tools? How can we all have input on what it should look like?  How can we both use the data as educators and keep the data from being mis-used by others?

Any thoughts? More questions? Please leave them in the comments!