Showing posts with label item review. Show all posts
Showing posts with label item review. Show all posts

Monday, March 5, 2012

First Things First

Years ago, I attended a writing workshop with Tom Jenks and Carol Edgarian. Now I don't even remember how I decided to go to this workshop, but I knew it was the right place for me when I learned that Anna Karenina (this translation) and Aristotle's Poetics were among the required reading for the week.


Now I'm reading Anna Karenina (again, I don't know how many times I have read it, though I don't think one could ever tire of it), and so I was thinking about something Tom and Carol said during the workshop, about how one's writing needs to have a big idea, that everything--everything!--in the writing should be developing and supporting this big idea.


As modest an endeavor as writing a test question is, it is still writing. Each question must have a big idea. And the item writer must know what that big idea is, and then marshal all of the everything of the item in support of that big idea.


Last November I went to that heaven on earth, home of all manner of delights, such as Frank Lloyd Wright houses and the Art Institute and French-fried green beans. I love Chicago. I love the people there--Stormy, husky, brawling/City of the Big Shoulders. (As the doorman of my hotel, whom I had come to know fairly well in the course of a few days of comings and goings, put me in a cab to travel to Oak Park late on a Friday evening, he said to the driver, "This here is my sister. You take care of her like she is my sister. You understand?" The funny part is that, indeed, we were of an age and did resemble each other closely enough to be siblings. Siblings raised apart, as we didn't share that distinctive accent.)


The reason for my visit was not just to have the best time in the world with my friend Carrie; it was to give a presentation on an assessment content development-related topic of my choosing. I rummaged around in my brain for a while before I came up with intention.


I thought of intention because of something that Kate Nash, my friend and genius dance teacher once said, probably in response to all of our awkwardly flailing limbs: that if you focus your intention, your bones will organize themselves. It reminded me of how, when I learned to ski, everyone told me not to look down, because I would fall. You cannot help but follow the direction of your gaze.


Then I found there was what seemed like an orienting magic in setting an intention. Having a laserlike focus burns off what is inessential. It builds a solid foundation. I tried intention in areas of my life other than dance. There was something about doing this simple step first that cleared away debris distractions.


Around that time, I was asked to perform triage ride in like the cavalry edit a set of questions that had been rejected by a customer. It soon became apparent that the main problem with the set was that the item writer had no firm intention. Not only was there no unifying purpose for the questions as a group, but each question could have been measuring two or more skills. Which meant that none of the questions could measure any skill accurately.


It takes time to do this, but more than time, it takes a reflective pause. Which may not sound like much--but when folks are busy and feeling overwhelmed, the reflective pause gets thrown overboard.


In the immortal words of Epictetus, First say to yourself what you would be, and then do what you have to do.


(When I returned home, my daughters were so jealous of all of my Chicago adventures, especially the French-fried green beans. I found a recipe and made a big batch and we ate a million each. It is safe to say neither of them will ever look at a French-fried green bean again. In fact, there is a ban on saying the words aloud in their presence.)


UPDATE: Identified supernova Kate Nash by name.



Friday, March 13, 2009

Be Easy, Baby

. . . in the immortal but out of context words of Sharon Jones and the Dap Kings.

I often used to conduct item and passage review meetings with groups of teachers. I liked doing it, not only because I like being large and in charge. I also liked traveling to different states and meeting teachers from all over the country (and hearing their accents). I liked talking about test questions and reading test passages. I liked giving the teachers information about assessment, information that would help them in the classroom and for which they were invariably grateful. (I especially liked how teachers, when they are away from the classroom, always behave like students of the age they teach. The primary grade teachers are wide-eyed and very enthusiastic and sweet and need a lot of direction to keep them focused. The upper elementary grade teachers are lively and they talk out of turn and like to take breaks. The middle school teachers are sometimes a little difficult to manage. The high school teachers wear their sunglasses inside and sit toward the back of the room and slump down comfortably in their chairs. )

One of my first such review meetings was in French Lick, Indiana. A couple of hours in, I suggested we take a break, and encouraged the teachers to stand up and stretch and move around to refresh themselves, which suggestion inspired them to tease me about my wacky California-ishness.

It's been years, but now I get to say that I was right. And I do confess that I regrettably harbor a tiny fondness for being right.

P.S. Meditation is also beneficial to students, as is knitting. All three activities change the brain wave patterns:
Clinical studies over the years have shown the effectiveness of interventions on a wide range of medical problems caused or made worse by stress, such as hypertension, cardiac arrhythmias, pain, insomnia, allergies, repetitive stress injury and infertility, among many others. Practicing the relaxation response daily can boost the immune system and make one more resistant to the harmful effects of constant stress.
Good for all of us, but especially at-risk students, who may not have many resources to help them with the stress of surviving in this sometimes hostile world.