Friday, May 15, 2009

Of first codings

I'm near the end of my first round of coding my first slice of data. I've been engaged in what is called micro-analysis, a line-by-line (even word by word) look at these textual artifacts. In this blog post, I want to write about my experience doing this micro-analysis (and not get into what I am seeing so far).

My initial task has been to underline sections of text and ask "What is going on here?" I'm looking at objects, events, acts, or happenings in the text. I've struggled mightily with the concept of categories—what is a category? That is what I am supposed to look for. Ian Dey specifically distinguishes them from names or labels. Gratefully, Strauss and Corbin have a helpful section on Open Coding. I looked at what I was doing, and I would say predominantly I was labeling what I saw. I had a lot of continuous tense verbs—showing evidence, affirming success, looking at draft, fitting in bounds. I see now that I was doing a lot of identifying and naming of what is happening for the students or happening in what they are doing.

The difficulty I have found is finding the right words for the labels. Often there are subtle shades of difference. What's the difference, for instance, between "showing evidence" and "offering specifics?" I'm using different language to describe the same essential thing. I saw a lot of where students would point to some fault or problem in either their draft of how they understood the assignment. Is it "admitting a fault" or "not fitting in bounds" or is there a better language to capture this form of self-assessment. But, as this last sentence illustrates, I have begun to categorize (I guess that is what I am doing) what is going on. I have grouped both pointing to faults or errors and point to successes as a form of self-assessment. Or should I call it "assessing the performance?" The problem of finding the right language to describe and label what I am seeing is difficult. It all seems a muddle, and it gets more muddled if I use different language. I've tried a few times to put aside the data and try to code the next set of artifacts with fresh eyes to see if I use different language. More muddle.

Let me describe two other things I have done as I did this first-level of micro-analysis. With most all the artifacts, I wrote a short note describing in a larger sense what was going on in this writer's review and what I thought of it. I also tried something Strauss and Corbin suggested, and that is to dig deeply into key words. For instance, I took the words "I believe" and "I realized" and wrote a string of synonyms beneath them trying to open up what the student may be really meaning when they say those words. This was helpful in places. I also noted what I considered "in vivo" names for what is going on. "Fit the assignment" is one example of what I marked as an in vivo term, though I have not decided to use it as a code yet.

Once I had coded all the artifacts, I took another blank sheet of paper and tried to determine classes of labels or what is going on. I was then able to fit a number of other labels within these classes. "Assessing the performance" became one where I could fit both self-assessment and peer assessment under that larger term. But things seem to be nested in loose ways, and how do I know when a sub-category should be its own category. For instance, I used the term "processing a problem" as a category which I had also put as a sub-category under "assessing performance." Both involved self and peer assessment. So where does this self and peer assessment go?

I'm used to from my literary analysis background to doing close reading, and I find myself slipping into this mode. I am not sure how to describe it, but at a certain point trying to process the muddle I feel like I have abandoned the identifying of categories, properties and dimensions.

I know that "constant comparative analysis" is a cornerstone of grounded theory, so I have attempted to do some comparing as I have reprocessed my initial micro-analysis. After I had spent some time just pulling together a comprehensive list of labels and groupings of labels (categories?), I decided to zero in on one common move I saw students doing and that was what appeared to be an end point generally described as "what I see now" or "what I realize" or "what I now know or know to do." Or even what I see to do next.

In writing a short memo about one of my artifacts, I saw that the student was telling a story, a narrative of sorts, of getting to this end point of what I labeled "knowing what to do." I'm not completely happy with the language of this term, but it works for now. Then I looked for this move or story in the different artifacts, finding it in pretty much each one. I diagrammed this narrative as a kind of flow chart. It seemed that there were different paths students took to get to this point of "knowing what to do." The diagram is messy at this point with some redundancies and I will next need to clean up this flow chart. What I am not sure of right now is whether I am on track by creating this diagram (is it an emerging theory) or am I going off-base. Drawing the chart along with examining the data made me see that this end point is really a middle point in some cases. Not only is there a sequence leading to this "knowing what to do" but there is a forward looking projected action in many cases, and these "what I will change" or do next are not all the same.

The goal of initial micro-analysis and open coding is to begin to identify categories and develop some emerging thoughts on theory (or what is going on here). I believe I have nearly accomplished this task with what I have done, but I'm uncertain of what to do next. How do I approach my next slice of data? I know that I need first to do some memoing to process my analysis so far to see where to go next. For me, especially, this reflective writing is very useful. I think I will do another round of micro-analysis on a set of writer's reviews done by students further along in their freshman comp sequence (1302 students) and see if similar patterns are evident or others are there.

I'm thinking right now that muddle is not all bad. I need to embrace the muddle and keep "muddling forward" and not get too stuck in figuring everything out at this point.

No comments:

About Writing

Writing is always more precise and less precise than our thoughts: that is why our writing pieces glow with being and beckon with the promis...