The how of standardized tests

Yesterday over donuts and coffee, I had the beginnings of an interesting conversation with a colleague. Our juniors are scheduled to take the Smarter Balanced Assessments (SBAC) at the end of this week, and it has been the source of a great deal of controversy over the past few months. MANY of the students are opting out, our federal funding is still officially at stake, there is a flurry of legislation pending in the state legislature, and there are very strong opinions on all sides.

I say it was the beginnings of an interesting conversation, precisely because of those strong opinions.  Since our school is required to give the tests, and since the students not opting out of the test will invest significant energy in doing well, I feel strongly that we should do our best as a school to get real, usable data.  To do otherwise means our results are essentially useless to us, even as a baseline for future testing.

My colleague feels (just as strongly) that the SBAC assessments are (1) damaging to kids because they test things the kids have not been taught in our current curriculum, and (2) part of an unethical, profit-driven cycle that we should disrupt in every legal way possible, including by opting our own children out of the testing and encouraging others to do the same.

Strong opinions can lead to strong reactions.  But as my neighbor the Zen priest says, “Just because you see the bus going by, that doesn’t mean you have to jump on and ride it wherever it is going.” In other words, don’t react without thinking.  Listen first, then consider, and then respond. Both my colleague and I did a good job on the surface; we appeared to listen thoughtfully to each other and discuss our disagreements like grownups.  (At least my colleague did, and I hope I did, too.)

But on my side, the key phrase is “appeared to,” and I know that part of that appearance was an act. Granted, I wasn’t just responding by reflex. I was thinking carefully before I spoke, largely because I really respect my colleague and didn’t want to offend her.  But mostly I was thinking, “How can I express myself really clearly so it’s obvious that I am correct on this?”  I was granting the validity of her arguments, but not really trying to put myself in the position of understanding and supporting her opinions.  I know that it’s intellectually lazy of me to disagree with someones opinions unless I’ve made that effort.  It also deprives me of some really interesting ideas.

So, with apologies to my colleague for not doing this in the moment, here I go.

Argument one against SBAC testing: It damages children to test them on content they don’t know.

I do believe that many, maybe most of our students are upset when they face test questions they can’t immediately see how to answer. Some of them are demoralized; they see it as confirmation that they aren’t good at the subject. Others get angry that they are being unfairly assessed on content they haven’t been taught.  But whose fault is that?  I think it is something we as educators have brought on ourselves, by never presenting kids with test questions that they shouldn’t immediately know how to answer. We scaffold the heck out of everything.  We try  to teach each student in Vygotsky’s zone of proximal development, but we take great care never to test them there.  We train students that we hope for them to get every answer correct, and we are disappointed when they don’t. We make fixed grading scales that penalize the students when the teacher writes a question they can’t wrap their heads around yet.  As a result, neither the teachers nor the students ever really find out what they can do.

This is poor preparation both for college and for life.  Both places are chock-a-block full of questions we don’t know how to approach.  Often our half-formed answers and attempts at answers have really important consequences.  We should be preparing for our entire lives to climb all sorts of challenging cliffs, hoping to find a hand- or toe-hold that will let us get up to the next ledge.  It should be fun and invigorating to do this.  As teachers, we need to prepare our kids in such a way that the majority of them get the chance to respond to challenges in this way, rubbing their hands together in anticipation. So how do we go about it?

My colleague is right.  We don’t do it by throwing a test like this at them for the first time when they are juniors in high school.  We don’t do it by throwing it at them once a year at “standardized testing time.”  But I’m right, too.  We really need to do it somehow, and we need a measure that shows we aren’t doing it now.

Argument two against SBAC testing: it is part of an unethical, profit-driven cycle that we should disrupt in every legal way possible.

I definitely agree that standardized testing has become way too profit-driven, and that a whole exploitative industry has grown up around our quest for data about our students.  I’m not sure how we should respond as teachers. I think it is really important not only to assess our students on what we have taught them, but also to know how their learning (and our teaching) compares to that in the rest of the world.  Any attempt to measure such a broad question is going to be imperfect, but that doesn’t mean the measurement isn’t important.

A bigger question is how to keep profit and exploitation out of the equation.  Is it even possible in our system? In an education system where every state and sometimes every local school district has a different curriculum, whom can we trust to come up with standardized measurement tools? How can we all have input on what it should look like?  How can we both use the data as educators and keep the data from being mis-used by others?

Any thoughts? More questions? Please leave them in the comments!


Beginner’s mind in teaching

I’m not a beginner at math. I’ve used it for decades (yikes!) for a wide range of things, from modeling flow in the earth’s mantle, to calculating drilling-mud weights in an oil well, to building the roof for a bay window, to calculating how big a load of goat manure my truck’s suspension can handle. I have known and forgotten more math than most of my students will ever see in their lifetimes.

I am, however, a beginner at teaching. I have very little formal training in pedagogy and child development. My file of teaching tricks is still very slim.  I don’t know most of the jargon that gives entry into the teacher clubhouse, and I make newbie mistakes in the classroom every day.  I am constantly amazed when a group of students will blindly follow my directions—as if I were an expert or something—and I live in fear of the moments of student revolt that inevitably happen, when a planned lesson goes all pear-shaped in the blink of an eye.

I am also a beginner at meditation.  I am a haphazard student of Zen Buddhist philosophy, mainly because my neighbor is a Buddhist priest. (She also danced to the Rolling Stones in a miniskirt and stiletto boots at her 50th birthday party this year, so she’s probably not what you were picturing.) In the best Zen tradition, I take what is useful to me from the practice, and what has most transformed me so far is the idea of beginner’s mind.

Beginner’s mind, or Shoshin, is a concept from Zen Buddhism, also known as “don’t-know mind.” It isn’t the same as ignorance. It’s an idealized state of being without preconceptions, open to what is really happening, and eager to learn and understand. A teacher with beginner’s mind doesn’t assume she knows the answers to questions.  She doesn’t assume that she knows the causes of student errors, even when they appear to be the same errors students have made in previous years. The teacher with beginner’s mind constantly asks, “What is really happening here?”

I’m kind of cheating, but not really. In a way, it’s easy to achieve beginner’s mind when you are new to something. As a new teacher, literally not knowing what I’m doing, I’m more likely to question my own methods and assumptions, and to listen to advice from more experienced teachers. But this constant questioning can be exhausting, particularly if I let myself feel that I should know, that I ought to be better at this by now.   True inexperience can actually be an impediment to achieving beginner’s mind.  Fear, defensiveness, pretending confidence—these are all reactions I’ve had to my lack of experience, both in the classroom and in meetings with my colleagues. These reactions are enemies of the “attitude of openness, eagerness, and lack of preconceptions” that I want to maintain.*  They also tempt me to fall back on the areas where I have confidence: applied math and science research.  They tempt me be to be an insufferable know-it-all in those areas in fact.

Instead, I try to embrace what I don’t know, and learn about it. I try to notice, not assume. I try to think not “This is an angry student,” but “This student has acted angry in class every day so far.” Not “This student can’t learn this stuff,” but “This student doesn’t understand what I just said.” Not, “This student is lazy,” but “This student doesn’t appear to be making any effort.” or even better, “This student is sitting without picking up his pencil, and he’s not watching what I am writing on the board.”

There’s a balance to strike, though.  As teachers, we have to plan, try to anticipate the errors that students can make, so that we can have resources at hand to help them recognize and correct their misunderstandings. We have to predict what students will find interesting, or funny, or boring, and we have to plan how long activities may take.  However, being willing to be wrong can lead to a better lesson. When I explicitly try not to assume the causes behind what I see happening, I’m more likely to find a way to solve the problem at hand.  The intentional cultivation of beginner’s mind also pays other, unexpected dividends in my life: better personal and professional relationships, better parenting, and renewed delight in simple mathematics that I thought I thoroughly understood.

For as long as I can call myself a beginner, I will try to use my lack of experience as an asset.  As I get better at this teaching thing, I hope I will also get better at the practice of beginner’s mind, so I can continue to see each student, each problem, each colleague with fresh eyes.  So please help me here, in the comments.  How do you keep things fresh for yourself and your students?  What benefits have you seen?


*I lifted those words directly from the Wikipedia page on Shoshin or Beginner’s Mind.  The full sentence is as follows: “It refers to having an attitude of openness, eagerness, and lack of preconceptions when studying a subject, even when studying at an advanced level, just as a beginner in that subject would.” I smiled when I read it.