Showing posts with label content area expertise. Show all posts
Showing posts with label content area expertise. Show all posts

Wednesday, May 16, 2012

Beginning at the Beginning

A great thing about this work is that I do a lot of research on esoteric topics, and in following the bread crumb trail, often end up in surprising places.


Anyone who knows me would be surprised to find me lurking at a programmer's blog. My most recent experience with programming was a college class in BASIC and Pascal, a class I took only because my father wanted me to, which was an early lesson in how disagreeable it is to do that which one is disinclined to do out of a desire to please another.


In spite of my dedicated efforts to the contrary, I miraculously passed this class in which I learned nothing but how to memorize like a monkey. (I got an A or a B, which didn't surprise me at the time--I was just relieved. Now I find it shocking.)


Really, all I remember of the class was how the professor had eyebrows that looked like furry caterpillars crawling across his face and how miserable I was one day, while I was shivering in the front row of the cavernous lecture hall--I'd ridden my bike through torrential rain to get to the campus, and my hair and clothes were soaked through. The skin on my face was wet. Puddles formed on the floor under my chair. 


And yet,today I found myself here in programming land:
I'm going to give you a piece of advice when you're trying to learn something new: Never listen to people who try to make beginners feel like losers. For whatever reason, some people get off on making beginners feel like they're worthless for attempting something. Maybe it's because they feel threatened by new entrants, or maybe they were picked on as kids and this makes them feel powerful. Who knows, but generally if they're trying to make you feel like a loser because right now you're not that good at something, then just ignore them. 
Few people enjoy the disorientation of not knowing what to do, especially those who are accustomed to being what my grandmother would have called quick studies. Probably the more capable one is, the less one likes feeling adrift in the sea of ignorance.


The other day I was telling a friend about how I'd once nearly spontaneously combusted at a country western line dancing class (I had intended to register for Cajun Zydeco, but there'd been a misprint in the catalogue, and so I thought, What the hey, might as well do this thing that I would have never in a million years considered doing, being as the only country music I ever listen to is either Johnny Cash or Patsy Cline, except for this). The teacher, used to students already well versed in that style, gave few demonstrations, but instead called out the names of steps and then corrected students as they flailed. Knowing neither the steps nor the names of the steps, I flailed mightily.


No matter what it is we find ourselves expert at now, we were all beginners once.
The truth is, if us old dogs really believe in a meritocracy, then we should be embracing beginners no matter what their reason for learning. If we believe that someone's capability has nothing to do with their past or qualifications, then that means everyone can improve and you have to evaluate them on their skill at the moment. Running around yelling at people because they didn't happen to follow your path is just spiteful resentment.
Another truth is that it's exhilarating to work with beginners. Their very unfamiliarity makes the whole world new again. They bring a new perspective that can be challenging--why indeed do we do that task in that particular way, is there a good reason, or is it just something that's become habit but has no value?--and this challenge to our established modes can be invigorating. If we let it.

Tuesday, April 3, 2012

Gap

As obvious as the link is between the quality of content (we could also say validity) and item writing training, it remains a mystery to me how sound practices in item writing training have nearly become obsolete.


Steven M. Downing discusses this link in "Twelve Steps for Effective Test Development" from the Handbook of Test Development:
Yet knowing the principles of effective item writing is no guarantee of an item writer's ability to actually produce effective test questions. Knowing is not necessarily doing. Thus, one of the more important validity issues associated with test development concerns the selection and training of item writers . . . . The most essential characteristic of an effective item writer is content expertise. Writing ability is also a trait closely associated with the best and most creative item writers.
. . .
Effective item writers are trained, not born. Training of item writers is an important validity issue for test development. Without specific training, most novice item writers tend to create poor-quality, flawed, low-cognitive-level test questions that test unimportant or trivial content. Although item writers must be expert in their own disciplines, there is not reason to believe that their subject matter expertise generalizes to effective item writing expertise. Effective item writing is a unique skill and must be learned and practiced. For new item writers, it is often helpful and important to provide specific instruction using an item writer's guide, paired with a hands-on training workshop (Haladyna, 2004). As with all skill learning, feedback from expert item writers and peers is required. The instruction-practice-feedback-reinforcement loop is important for the effective development and maintenance of solid item writing skills. . . .
The best and most effective training, then, is to teach item-writing skills to content area experts, give them a guide for reference, let them practice, review and comment on their work, have them make revisions, and review and comment again until the items are satisfactory. Add a peer review step -- but only if the peers have a thorough understanding of the principles for developing sound items. Repeat as necessary.


In other news, April is National Poetry Month. I like the idea of carrying a poem in your pocket.