Friday, June 27, 2008

Theory and Generating Theory

If my dissertation is going to be about "generating theory," I need to have clear answers to these questions:

What is theory?

What does it mean to "generate theory?"

What is the need for "theory" in the use of reflection between the drafts within the activity of writing?

This shift to generating theory means some important things for my research and dissertation--it means it is not going to be about proving that this pedagogical approach is valid and valuable and EVERY composition teacher should adopt it. I think it means that from my research we can better understand what happens when students are asked to reflect in this way. I'm jumping ahead of myself.

What is theory?
Strauss and Corbin in Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory (1998)define theory this way:

"For us, theory denotes a set of well-developed categories (e.g. themes, concepts) that are systematically inter-related through statements of relationships to form a theoretical framework that explains some relevant social, psychological, educational, nursing, or other phenomenon. ...A theory usually is more than a set of findings; it offers an explanation about phenomena" (22).

Theory, then, is an intellectual framework of understanding (contingent and even localized in scope) that offers an explanation about phenomena, such that it may offer explanatory and predictive indications. Theory's most useful property is to offer explanation and prediction to practice. One can shape and forms ones actions/practice based upon this theory.


...to be continued

Pre-Dissertation Proposal



Pre-dissertation Proposal
Lennie Irvin
Ph.D. Student in Technical Communication and Rhetoric, Texas Tech University


Identify the Problem Requiring Research
The problem I propose to address with my dissertation research can be illustrated through the recent history of Freshman Composition at Texas Tech University. A number of years ago, between-the-draft reflections were included as a core component of the curriculum. After each draft and after each peer response, students were asked to reflect upon their piece of writing and what they might do to improve that draft for the next one. The activity was included in the curriculum based upon the belief that such reflections helped students develop a critical self-awareness and thus greater control of their own writing activity. In Fall 2007, however, these between-the-draft reflections were taken out of the curriculum. They were seen to have no significant benefit and to be extra work on already overloaded students (and graders). The decision was based upon a belief that students wrote these reflections without engagement and without effect upon their practice or end product.

This back and forth inclusion and exclusion of such in-task reflection speaks to the problem surrounding this pedagogical activity. We don’t know enough about what happens for students as they reflect or about its possible influence on students’ writing and learning within a Freshman Composition class. We don't have a theory that adequately explains and describes what happens for students as they reflect in this way, so that this pedagogical exercise can be used effectively in the classroom. This dissertation study proposes, then, to address this problem by using grounded theory and comparative analysis of student writing and reflections within Freshman Composition to generate such a theory.

The Research Questions focusing this study are:

How do teacher-prompted rhetorical reflections performed by freshman students at TTU influence and related to students’ learning and writing practice?

Can a comparative analysis of teacher-prompted rhetorical reflections generate a theory to explain and describe what happens when students engage in this activity?


Definition of terms:
“teacher-prompted rhetorical reflection” refers to a pedagogical activity when a teacher asks a student to reflect upon their writing and writing performance between drafts. The term “rhetorical reflection” designates the in-task nature of reflection and is defined more clearly later.
“learning” refers to a change and growth in thinking and practice experienced by the learner.
“comparative analysis” is a method of textual analysis used in grounded theory to generate theory.

Review Some of the Basic Literature Regarding the Problem

Jennifer Moon in her book Reflection in Learning & Professional Development (1999) offers a comprehensive definition of reflection and its place in learning: "reflection itself is a mental process with purpose and/or outcome. It is applied in situations where material is ill-structured or uncertain in that it has no obvious solutions, a mental process that seems to be related to thinking and to learning" (5). What distinguishes different kinds of reflection is not the process or nature of the reflection, but the "framework" or purpose to which it is used: "it is the framework of intention and any guidance toward fulfillment of that intention that is significant in distinguishing one act of reflection from another. The mental process itself may not differ from one situation to another" (15). My own understanding of reflection is rooted in Moon’s comprehensive definition.

I want to provide a broad overview the various frameworks of reflection discussed in multiple disciplines, and then direct my discussion toward how reflection is mainly understood in Composition Studies.

Philosophic View of Reflection
What I am calling the philosophic view of reflection refers to how it is seen as a form of judgment or wisdom that can flexibly apply general principles to specific contexts. This form of judgment resembles what Aristotle would call phronesis. Immanual Kant (1790), Gadmer (1975), Farrell (1993), Phelps(1988), King and Kitchener and their Reflective Judgment Model (1994), and even Rand Spiro’s (1992) notions of “cognitive flexibility” represent thinkers that fit this philosophic view towards reflection.

Reflection for Emancipation
The central thinker for this kind of reflection is Jurgen Habermas who approaches reflection as a tool to develop particular forms of knowledge—specifically, a broader awareness and truer understanding with the goal of freeing one from previous thinking or situations. This form of emancipatory reflection is central to “critical theory” and its goal of revealing oppressive constructs in order to change them. This school of reflection since it is often applied in political, social, or psychological areas rather than in education.

Reflection and Learning
John Dewey is probably the central thinker who discusses the importance of reflection for learning and problem-solving, and his definition of reflection has been the dominant understanding of reflection within education in the 20th century. Dewey defined reflection as “active, persistent and careful consideration of any belief or supposed form of knowledge in light of the grounds that support it and the further conclusions to which it tends” (9). As Jennifer Moon describes, “Dewey’s more detailed analysis of reflection rests on interpretive interests, in ‘making sense of the world’ in the process of effective education” (15). His emphasis on problem-solving and strategizing connects with a large school of reflection and experiential learning focused around David Kolb’s “experiential learning cycle” which contains “reflective observation” as a key part of the learning cycle. The writing process can be viewed as an experiential cycle with reflection placed within each iteration as an activity to generate understandings and abstract concepts to guide the next draft. Jennifer Moon’s “map of learning” positions reflection as needed for an “upgrade” of learning as a learner progresses up the “stages of learning” (154). Jack Mezirow’s notions of reflection and what he calls “Transformational Learning” are also significant. In his view reflection is a form of validity testing that leads to transforming “meaning schemes” (specific attitudes or beliefs) or “meaning perspectives” (sets of meaning schemes) (101).

Reflective Practice
Another school of reflection focuses on the “reflective practitioner.” Donald Schon’s (1983, 1987) notions of “reflection-in-action” and “reflection-on-action” have been enormously influential in the areas of professional development, such as medicine, business, and teacher education. George Hillock’s book Teaching Writing as Reflective Practice represents one important example in the field of writing. This kind of reflection focuses predominantly on generating the moment-by-moment capacity for effective practice (similar to practical wisdom or phronesis).

Views of Reflection in Composition
Within Composition Studies, reflection has been used following two main frameworks or purposes. I have labeled these two purposes as “curricular” or “rhetorical,” and they can be understood by describing them according to the three poles of reflection.



Curricular reflection is defined as post-task, retrospective reflection done predominantly to construct and demonstrate learning for an audience (often a teacher for the purpose of evaluation). Yancey (1998) in her book Reflection in the Writing Classroom calls this type of reflection “Reflection-in Presentation.” It is typically performed at the end of a unit, or at midterm, or at the end of a semester. Within Composition Studies, this type of reflection has predominantly occurred in reflective letters accompanying end-of-course portfolios, and most scholarship about reflection has focused on this type of reflection (Yancey, 1997, 1998; Black, Sommers, and Stygall, 1994; Hamp-Lyons and Condon, 1993, 2000; Camp, 1998). Additional scholars on this “reflection for learning” or constructivist view of reflection in Composition include Gleason (1993), Hughes and Kooy (2002), Brown (1998), Qualley (1997), J. Sommers (1989), Perl (1980), and Underwood (1998). Another aspect of “curricular reflection” is its role in the transfer of knowledge and skill. My study will concentrate on reflection inside the activity of writing, not its affect outside of it.

My focus in this dissertation research will be on the second type of reflection considered in Composition Studies--what I am calling “rhetorical reflection.” Rhetorical reflection is defined as in-task reflection done between drafts predominantly for a writer’s own purposes of validity testing or problem-solving within the activity of writing. The dominant theorist and researchers of reflection or metacognition within the writing process are Flower and Hayes and their cognitive process theory of writing (1981). Their work, along with research into the psychology of writing done by Bereiter and Scardamalia (1987) and many others, has continued to be a basis for our understanding and study of writing (as attested to by two recent collections by Alamargot and Chaquoy (2001) and Allal, Chanquoy, and Largy (2004)). In their various models, reflection as a form of reviewing and monitoring comprises a significant part of the cognitive operations of composing. Another closely-related concern in Composition to reflection has been attention paid to student self-evaluation or self-assessment, particularly as it applies to revision. These between-the-draft, prompted activities of self-evaluation are extremely similar to my focus on rhetorical reflection (N. Sommers 1992). Chief scholars and researchers on this kind of self-evaluation in Composition include Beach (1976, 1980, 1984), Haswell (1993), Moore (1993), Anson (2000), Harris (2003), and Yancey (1998). Most argue that this kind of self-evaluation is crucial for helping students write and revise better.


What a preliminary investigation into research on rhetorical reflection shows:
(from 29 research or research-related articles; not all studies refer to writing)

"Deep reflection" correlates to better performance
A number of studies conclude that better or more sophisticated reflection leads to better performance (whether that was writing performance or teaching skill). Anson (2000) finds a relationship between writer's proficiency and their blending/shifting of "function in scheme" (i.e. more sophisticated reflective thinking). Likewise, Ellis (2005) sees a "cohesive" conception of writing (revealed in reflections) with a deeper approach to writing. Each also notes that more surface or less sophisticated sorts of reflection reveal less proficiency. Each is noting a correlation between deeper reflection and better performance. The other studies that follow this general conclusion are Higgins (16), Kennison (2006), and Yeo (2006). The larger question is--what significance does this correlation mean?

Reflection is a tool for meaning formation/negotiation, contextual knowledge and action
Implications from three studies--Flower (1994), McAlpine (1999), and Peck (1989)--suggest that reflection has a significant role to play in the formation and negotiation of meaning and action. This conclusion or assumption seems to relate closely to the previous convergence on "deep reflection."

The importance of the affective or emotional in reflection
Studies done by Efkides (2006) and Shapira (2005) highlight the important role affect or feelings and emotion have in impacting reflective judgment. Shapira's research is interesting because she concludes that "affective strategies" have the most important influence on improving writing quality and confidence.

A complicated link between reflection and revision
Studies done by Rijlaaradam (2004) and Peck (1989) highlight the difficulties in connecting what happens in a reflection and what ultimately happens in a revision. These researchers caution against making a clear cause-effect connection.
Measuring reflection
Multiple studies use some sort of coding scheme to evaluate reflective texts for analysis that could be prototypes for an eventual coding scheme I could use for my analysis of reflections. Anson (2000), McAlpine (1999), and Raphael (1989) probably have the best coding schemes. Beach (1976) and Yancey (1998) are also excellent, but they are evaluating self-evaluation texts (roughly equivalent to reflections). Yancey has a scheme similar to Anson’s, and Beach's is interesting because he presents results on productive self-evaluations that could then be used as the basis for forming a coding scheme. The one critical voice regarding the measuring and analyzing of reflections is Sumsion (1996) who strongly disagrees with the quantitative measurement of reflection (however, she bases this conclusion on a suspect study of her own).

What is the gap in our understanding of reflection in Composition?
We actually have an incredibly rich theoretical understanding of reflection. The large gap I see in our conception of reflection at this time within Composition Studies is fully appreciating the link between reflection and invention (that is reflection’s epistemic and transformative role in learning and writing practice). So much attention is paid to post-task reflection for the purpose of assessment, the self-construction of learning, and transfer that this other form of Deweyian, problem-solving reflection has not received the attention it deserves. It is my contention that reflection strategically applied within the activity of writing heuristically reactivates the concerns of invention (namely, the full concerns of the writer’s “rhetorical stance”) with a beneficial influence on the writer’s performance and learning. The cognitivist have identified reflection or metacognition as a significant mental activity applied within their model of the activity of writing, and research has identified a correlation between “deep reflection” and better performance, but empirical research has not developed a theory to understand the features of this deep reflection in terms of writing, rhetorical stance, and invention.

Outline Goals and Methods of Research for Adding to the Knowledge Regarding the Problem

To fill this gap in our understanding of rhetorical reflection as a pedagogical activity, I propose studying the writing and reflective texts produced by Freshman writers within the First Year Writing Program at Texas Tech. My study will be an archival study examining texts within the TOPIC database from the academic year 2004-2006, which contains thousands of these texts. This data set offers the unique opportunity to study thousands of texts both through textual analysis, but also through datagogic methods of data-mining. Datagogic within Composition Studies refers to the use of databases as a central site where all writing is submitted in a writing course. “Datagogic methods” refers to new methods of researching writing within this new database setting.

According to Glaser and Strauss (1967), this dissertation research would be considered a beginning step in generating theory. They believe the initial establishment of catagories and properties are best established by first minimizing differences among the comparison groups (55). My data set of freshman writers of roughly the same age from the same school represents such a “minimized” group. Only after these categories and properties are established within this relatively homogeneous set of groups should the researcher turn to “maximizing” the differences among comparative groups to further refine and develop the theory. This direction toward maximizing differences among comparison groups points to a possible post-dissertation research agenda.

The first phase of my research will be to do this basic work of generating theory within a minimized group (TTU Freshman Composition, TOPIC). Glaser and Strauss state two criteria for the generation of theory. The theory generated must “fit” the situation and “work” when put to use: “By 'fit' we mean that the categories must be readily (not forcibly) applicable to and indicated by the data under study; by 'work' we mean that they must be meaningfully relevant to and be able to explain the behavior under study” (3). The second phase of my research will engage in confirmation of the fitness and workability of the theory generated by engaging in Content Analysis of a large sample of student writing from TOPIC as well as strategic data mining within the TOPIC database.


The following chart derived from Creswell (2003) will describe my general research design:
Research Approach
Qualitative

Knowledge Claims (epistemological stance)
Constructivist

Strategies of Inquiry
(methodologies) Grounded theory

Methods
Comparative Analysis of texts
Additionally, possible Content Analysis and data-mining
Sample/Sampling Theoretical sampling of various groups of Freshman writers and writing from within the TOPIC database. In theoretical sampling, the process of data collection is controlled by the emergence of theory.

A second phase of the study to verify the discovered theory might entail Content Analysis and data mining Data Analysis Close textual analysis of texts will be used following grounded theory's method of comparative analysis.

From this comparative analysis, derive a coding instrument for analyzing these reflections by a team of coders. Identify key search parameters for large-scale data mining.

My research process as I see it right now might follow this path.
1. Use grounded theory to discover categories, properties, and their interrelation and generate a theory
2. Derive a coding instrument from this grounded theory analysis
3. Apply this coding instrument to the content analysis of a sample of texts to check the understandings derived from the grounded theory analysis
4. Use large-scale data-mining analysis to further triangulate some of the understandings coming from the previous research efforts


Outline of Chapters
I. Introduction: The Rationale for Studying Rhetorical Reflection
II. Literature Review on Reflection in Learning
III. The Connection of Reflection to Invention
IV. Methodology and Methods for Research Study
V. Results from Study
VI. Implications for Practice

Explanation of Reading List Materials and Their Relation to the Dissertation Research
The scholarship contained in my reading list will contain four broad categories: reflection, invention, composition/rhetoric and rhetoric, and research methods. Since the focus of my inquiry is on reflection, the bulk of my reading list will contain readings related to reflection. These readings will contain general scholarship on reflection, reflection in education, and reflection within Composition/Rhetoric. Since reflection is so often linked to learning, this section may contain theories of learning that are applicable to reflection. Invention is added as a special category in my reading list because I believe there is a link between reflection and invention, especially as it relates to a writer negotiating their rhetorical stance within the activity of writing. The third category will present foundational text within the field of Composition/Rhetoric as well as in Rhetoric. I don’t propose to present a laundry list of Composition and Rhetoric text, but I will include texts which have been significant in my understanding of writing and rhetoric. The last category will deal with research and research design. Although I will present some foundational texts for researching (such as MacNealy (1999) and Johanek(2000)), I will also include texts focused directly on the methodologies and methods I will use in my study, particularly Grounded Theory.

Works Cited
Alamargot, Denis and Lucile Chanquoy. Through the Models of Writing. Dordrecht: Kluwer
Academic Publishers, 2001.
Anson, Chris. "Talking About Writing: A Classroom-Based Study of Students' Reflections
on Their Drafts." Self- Assessment and Development in Writing: A Collaborative Inquiry. Ed. Jane Bowman and Kathleen Blake Yancey. New Jersey: Hampton Press, 2000. 59-74.
Beach, Richard. "Self-Evaluation Strategies of Extensive Revisers and Nonrevisers." CCC
27.2 (May 1976): 160-64 pp. 2 Aug. 2007.
---. "The Effects of between-Draft Teacher Evaluation on High School Students' Revising of
Rough Drafts." Research in the Teaching of English 13 (1979): 111-19.
Beach, Richard and Sara Eaton. "Factors Influencing Self-Assessing and Revising by College
Freshmen." New Directions in Composition Research. Ed. Richard Beach and Lillian S. Bridwell. vols. New York: The Guilford Press, 1984.
Bereiter, Carl and Marlene Scardamalia. The Psychology of Written Composition. Hillsdale:
Lawrence Erlbaum Associates, 1987.
Black, L., Daiker, D. A., Sommers, J,.& Stygall, G. (Eds.). (1994). New Directions in Portfolio
Assessment. Reflective Practice, Critical Theory, and Large-scale Scoring. Portsmouth, NH: Boynton/Cook Publishers.
Brown, William. "Power of Self Reflection through Epistemic Writing." College Teaching
46.4 (Fall 1998): 135-8 pp. San Antonio College Library. 25 April 2002.
Camp, Roberta. "Portfolio Reflection: The Basis for Dialogue." The Clearing House 72.1
(Sep/Oct 1998): 10-12 pp.
Creswell, John W. Research Design: Qualitative, Quantitative, and Mixed Methods. 2nd ed.
Thousand Oaks: Sage Publishing, 2003.
Dewey, John. How We Think. Boston: DC Heath, 1933.
Efklides, Anastasia. "Metacognition and Affect: What Can Metacognative Experiences Tell
Us About the Learning Process?" Educational Research Review 1.1 (2006): 3-14 pp. 15 July 2007 .
Ellis, Robert, Charlotte E. Taylor, and Helen Drury. "Evaluating Writing Instruction through
an Investigation of Student's Experiences of Learning through Writing." Instructional Science Spring 33 (2005): 49-71.
Farrell, Thomas B. Norms of Rhetorical Culture. New Haven, CT: Yale University Press,
1993.
Flower, Linda and John R. Hayes. "A Cognitive Process Theory of Writing." College
Composition and Communication 32 (1981): 365-87.
Flower, Linda. The Construction of Negotiated Meaning: A Social Cognitive Theory of
Writing. Carbondale: Southern Illinois Press, 1994.
Gadamer, Hans-George. Truth and Method. New York: Seabury, 1975.
Habermas, Jurgen. Knowledge and Human Interest. London: Heineman, 1971.
Glasser, Barney G. and Anselm L. Strauss. The Discovery of Grounded Theory. Chicago: Aldine Publishing Co., 1967.
Gleason, Barbara. "Self-Reflection as a Way of Knowing.Phenomenological Investigations in
Compositions." Into the Field: Sites of Composition Studies. Ed. Ann Ruggles Gere. vols. New York: Modern Language Association, 1993.
Hamp-Lyons, L., & Condon, W. Assessing the Portfolio. Principles for Practice, Theory, and
Research. Cresskill: Hampton Press, 2000.
Hamp-Lyons, L., & Condon, W. (1993). Questioning assumptions about portfolio-based
assessment. College Composition and Communication, 44(2), 176-190.
Harris, Joseph. "Revision as a Critical Practice." College English 65.6 (July 2003): 578-92.
Haswell, Richard H. "Student Self-Evaluations and Development Change." Student Self-Evaluation: Fostering Reflective Learning. Ed. Jean MacGregor. San Francisco: Jossey-Bass Publishers, 1993. 83-100.
Higgins, Lorraine, Linda Flower, and Joseph Petraglia. "Planning Together: The Role of Critical Reflection in Student Collaboration." Written Communication 9.1 (1992): 48-84.
Hillocks, George. Teaching Writing as Reflective Practice. New York: Teachers College
Press, 1995.
Hughes, Herman Woodrow, and Mary Kooy. "Dialogic Reflection and Journaling." The
Clearing House 70.4 (Mar/Apr 1997 ): 187 pp. San Antonio College Library. 13 May 2002.
Johanek, Cindy. Composing Research: A Contextualist Paradigm for Rhetoric and
Composition. Logan: Utah State University Press, 2000.
Kant, Immanuel. Critique of Judgment. Trans. Werner S. Pluhar. New York: Hackett, 1790.
Kennison, Monica. "The Evaluation of Students' Reflective Writing for Evidence of Critical
Thinking." Nursing Education Perspectives 27.5 (Sep/Oct. 2006): 269-73.
Kolb, David A. Experiential Learning: Experience as the Source of Learning and
Development. New Jersey: Prentice Hall, 1984.
King, Patricia M., and Karen Strohm Kitchener. Developing Reflective Judgment. San
Franscico: Jossey-Bass, 1994.
MacNealy, Mary Sue. Strategies for Empirical Research in Writing. New York: Longman,
1999.
McAlpine, L., et al. "Building a Metacognitive Model of Reflection." Higher Education 37
(1999): 105-31.
Mezirow, Jack. Transformative Dimensions of Adult Learning. San Francisco: Jossey-Bass,
1991.
Moon, Jennifer A. Reflection in Learning & Professional Development. London: Kogan
Page, 1999.
Moore, William S., and Steve Hunter. "Beyond 'Mildly Interesting Facts': Student Self-
Evaluations and Outcome Assessments." Student Self-Evaluation: Fostering Reflective Learning. Ed. Jean MacGregor. San Francisco: Jossey-Bass Publications, 1993. 65-82.
Peck, Wayne C. "The Effects of Prompts Upon Revision: A Glimpse of the Gap between
Planning and Performance." National Center for the Study of Writing and Literacy Techinical Report No. 26. May 1989. 15 July 2007. .
Perl, Sondra. "Understanding Composition." College Composition and Communication 31.4
(Dec. 1980): 363-69 pp. San Antonio College Library. 25 April 2005.
Phelps, Louise Wetherbee. Composition as a Human Science. Oxford: Oxford University
Press, 1988.
Qualley, Donna. Turns of Thought: Teaching Composition as Reflexive Inquiry.
Portsmouth: Boynton/Cook, 1997.
Raphael, Taffy E., Carol Sue Englert, and Becky W. Kirshner. "Students' Metacognitive
Knowledge About Writing." Research in the Teaching of English 23.4 (1989): 343-79.
Rijlaaradam, Gert, Michel Cousijn, and Huub Van Den Bergh. Revision: Cognitive and
Instructional Processes. Boston: Kluwer Academic Publishers, 2004.
Shapira, Anat, and Rachel Hertz-Lazarowitz. "Opening Windows on Arab and Jewish
Children's Strategies as Writers." Language, Culture, and Curriculum 18.1 (2005): 72-91.
Schon, Donald A. Educating the Reflective Practitioner. San Francisco: Jossey-Bass
Publishers, 1987.
---. The Reflective Practitioner. San Fransisco: Jossey-Bass, 1983.
Sommers, Jeffrey. "The Writer's Memo: Collaboration, Response, and Development."
Writing and Response: Theory, Practice, and Research. Ed. Chris M. Anson. vols. Urbana, IL: National Council of Teachers of English, 1989. 174-86.
Sommers, Nancy. "Between the Drafts." College Composition and Communication 43
(1992): 23-31.
Spiro, R.J., Feltovich, P.J., Jacobson, M.J., & Coulson, R.L. “Cognitive flexibility,
constructivism and hypertext: Random access instruction for advanced knowledge acquisition in ill-structured domains.” Constructivism and the Technology of Instruction. Eds. T. Duffy & D. Jonassen. Hillsdale, Erlbaum: 1992.
Sumsion, Jennifer, and Alma Fleet. "Reflection: Can We Assess It? Should We Assess It?" Assessment & Evaluation in Higher Education 21.2 (1996): 121-31.
Underwood, Terry. "Teaching Writing with Reflective Questions and Reflective Events
(Reflective Classroom Culture as a Part of the Portfolio Process)." The Clearing House, Sep-Oct.1998. 1-9. Vol. 72.
Yancy, Kathleen Blake. Reflection in the Writing Classroom. Logan: Utah State University
Press, 1998.
---. (1998). Reflection, self-assessment, and learning. Clearing House, 72(1), 13-18.
Yancey, K. B., & Weiser, I. (Eds.). (1997). Situating Portfolios. Four Perspectives. Logan, UT:
Utah State University Press.
Yeo, Roland K. "Learning Institution to Learning Organization: Kudos to Reflective
Practitioners." Journal of European Industrial Training 30.5 (2006): 396-419.

Friday, May 16, 2008

The path becomes clearer

I just got out of my annual review with my dissertation committee, and I believe that the previous meetings with them and our "wranglings" with the subject of my study and the possible research design has paid off. Everyone clearly understands what the subject of my study is and we have general agreement on what exactly about the subject ("rhetorical reflection") I will study. I think this actual focus of my study may be fluid, but I think with time will gain more focus.

What has made the BIGGEST difference is that we all decided to make this an archival study of between the draft reflections within TOPIC. There are some disadvantages in this study since I can't actually interview my subjects, but it sounds like there are other methods of member checking and triangulation that I could use and develop. The increadible advantages of using the archive is that it is stable, no IRB would be needed (we'll have to check that), and I have access to a vast pool of data. I can do random samples, as well as perhaps some larger "data-mining." It also has the possibility for a kind of longitudinal look at a student's reflections and writing growth over an entire year.

I will talk more later about how to dig into this study, but for now I feel enormous relief to have this much defined (for now).

Tuesday, May 13, 2008

Wrangling with Research

Back in Lubbock--2008 TTU May Workshop

I just finished a two and a half hour session with Rich over my dissertation question and possible research study design. I feel incredibly wrung out and my legs are shaky. Funny how that is. I want to do a bit of thinking in words about what we came up with. My day will be filled with meeting with professors about this project, so this represents some of my initial thoughts. In many ways, my focus has not changed—it is on what is going on for freshman writers as they reflect between drafts. Does it impact their negotiation of thinking and task within the activity of writing, and if so how? Key terms to define:
Reflection-rhetorical reflection
negotiation
thinking
task
activity of writing
impact

Here is the basic outline of the study design:
Use TTU students (1302 student since I am targeting next Spring)
Create a set of reflective prompts to insert into a selected cohort of TTU students
Sample size—100?
Create a content analysis rubric for analyzing these reflective pieces
Analyze the full sample
Case study of five students in sample with more detailed analysis and interviews
Interview teachers in the study for further triangulation

The study depends to a large degree on Susan’s cooperation and support. It means I would need to set up my pilot for fall on 1301 students. I would need to develop my content analysis rubric and test it. I would need to get IRB approval for Fall and then again for Spring.

The good thing about this is that if I have this design defined and approved, then I can move forward. I am not able at this moment to critically reflect on this design so far, but perhaps more conversation and the time between now and Friday will help me piece together what I think of it.

Key things to think about as I reflect upon this question and design—
WGRA? –what is the so what behind all of this
What about my place in all of this. Can I look at my me wrangling with this study and critically reflect upon what I am doing? Will I see something to negate or to confirm?

This will have to come later. Right now I have a chorus of voices from other studies that echo my question, and I need to pull together these various voices into the same song and find the melody or harmony amongst these scattered looks at basically the same thing. But there is not an exact correspondence between these scattered voices and my own emphasis, so I will have to interpolate amongst them. That will be the challenge.

Other things from the morning session:
I need to explore whether to use grounded theory in the development of my content analysis instrument. I need to answer more exactly what I think is going on in reflection. I need to work on my research question until it is more refined. I also need to be prepared to define my terms. I think I have the categories of my reading list: 1. Reflection/rhetoric, 2. Invention/rhetoric, 3. Composition/Rhetoric, 4. Research. What else? I will probably need to explore more literature on learning theory and its relation to reflection.

My afternoon consisted of meetings with Susan and Becky. It looks like Susan would be cooperative and helpful if I were to do the study on TTU students in the FYWP. The one modification is that the writer's reviews for the study group would probably be done in-class. That's OK and would work.

My session with Becky was very extensive and has me rethinking a lot. I need to think a whole lot on the "so what" factor. She suggested an alternative study design that sounds intriguing:

Use samples of between the draft reflections from a larger sample of writing classes: 0301, 1301, 1302, 2 Sophmore classes (maybe not in English). Students would come from SAC, and I would have to recruit teachers to join me in the study. It would be a more complicated and elaborate study in terms of gathering data, but I believe I might be able to swing it. Another bonus would be that it examined reflection in a writing context beyond just freshman writing. We would be able to examine the uses of reflection at different levels and different disciplines.

I'm pretty beat and need to think more. As Becky said, I am in the reflection womb or bubble. I need to step out of it for a little bit and gain some perspective. This may prove hard to do... .

Saturday, March 15, 2008

Web 3.0

I raised the topic of what I called Web 3.0 in class last week, and I promised to write about what I meant. Here it is. I think the place to start is by talking about what Web 2.0 means. I am writing in a W2.0 environment right now (my blog which I will repost inside our class wiki). I know many people have written about W2.0, and I will make no claim to being an expert, but I will give my take.

W2.0 is about what has been called the read/write web. Its native environment is the internet, and it is about communicating within this environment. It is a set of tools designed (and streamlined) to make this communication easy. Ease of use. Like this blog--I sign in, click a button, and have an easy textbox where I can type my thoughts. When I'm done, there at the bottom in a big orange rectangle is PUBLISH POST. Easy. Another aspect of "easy" with W2.0 is that most all W2.0 tools/applications are free and webnative. I don't have to pay anything to use them or host them. I just go to that site on the web where I have created an account and GO!

The problem, from my view, with many W2.0 tools is that this ease of use comes at a cost. I'll call it the template box. Most all W2.0 tools in order to facilitate ease of use have created nice square boxes for all content to fit within. This blog for instance is dominated by CSS. The same font throughout. The same page design throughout. I can choose a new template, but I have that same uniformity throughout. There is no way to change particular pieces of a blog site. The blog by setting up the CSS makes it easy. It gives me the power to post easily, but it also restricts me in many ways in the name of this ease of use.

What I see happening in W3.0 is that users will begin to have greater control to manipulate and customize their own actions within their tools. Think of all the options available to you for customizing text within MSWord--you may not have all of them in your blog, but you'd have a lot more than now.

If we think in the analogy of legos. Right now W2.0 gives us pre-made lego creations. The construction and design of the toy is already done for us. We play with what is given to us. In the W3.0 world, we will be given the ability to manipulate the pieces and make creations on our own (what they call in the lego world as "freestyle"). This form of creation makes me think of MOO. MOO, in fact, is part of my paradigm for W3.0. You can take objects and bring them into your space which is of your own creation and you can customize these object--make them into something completely new.

So how will that affect the teaching of writing? ...That will have to wait until next post.

Thursday, February 28, 2008

Asking the Wrong Questions?

I want to do some "methodological musings" here that relate to both our class reading and my own research interest. I'll first frame my interest in methodology. I am at a stage in my PhD work where I need to define more specifically what I will research and how I will go about researching it. I will need to define my "research question" as well as my philosophy for investigating phenomenon and "making knowledge" from that investigation (in other words, my methodology). My focus of interest is on reflections done between drafts, so my research question is roughly, "What is the role of reflection within the activity of writing?"

Stephen North uses the term "mode of inquiry" in his book The Making of Knowledge in Composition. He offers this rather broad definition of "mode of inquiry": "modes of inquiry--the whole series of steps an inquirer follows in making a contribution to a field of knowledge--as they operate within methodological communities: groups of inquirers more or less united by their allegiance to one such mode, to an agreed-upon set of rules for gathering, testing, validating, accumulating and distributing what they regard as knowledge" (1). Interestingly, North frames validity in methodologies as a social construct: "An inquiry produces knowledge to the extent to which it is sanctioned by some community of inquirers"(276). That means if the community validates quantitative, experimental designed studies, then that is what makes "knowledge" for that group. The mechanics of forming belief are socially derived.

North may be right; however, I believe that we might philosophically be able to claim one methodology as better for studying a particular subject or phenomenon than another methodology. The key is what is being studied. Is the subject of study something that fits within what Fred has called "closed systems" or "open systems?" Does this object operate within defined and repeated "laws" of behavior such as we might see in chemistry? Fred summarizes this "scientism" or positivism with this quote:

"The principal method of investigation, which has been exceedingly successful in the last four centuries, has been to isolate significant elements of a repeating natural event and determine cause and effect, combining minute elements in ever larger hierarchies until the specific cause or causes of major events can be understood."

However, not all phenomena is "mechanical" or fitting within constraints of these closed systems. In contrast, some systems are "open" and here is where Prigogine and Stengers make a startling statement:

"while some parts of the universe may operate like machines, these are closed systems, and closed systems, at best, form only a small part of the physical universe. Most phenomena of interest to us are, in fact, open systems, exchanging energy or matter (and, one might add, information) with their environment. Surely biological and social systems are open, which means that the attempt to understand them in mechanistic terms is doomed to failure."

Fred goes on to point to Complexity Theory as theorizing these open systems and stating: "Complexity Theory has shown that complex, self-organizing, adaptive systems behave in ways completely unamenable to the investigative activities of how most scientists have always done science." If we consider that language and language use, especially the act of meaning making through written language is a complex, open system, we are doomed to failure to seek mechanistic, cause-effect answers to language use. For instance, a question like "What effect does reflection have on students' revisions?" would be the wrong kind of answer. The system, the variables, the multiple subjects and multiple ways in which phenomena is influenced and received is too complex to determine any sort of cause-effect relationship that would hold up.

Louise Wetherbee Phelps in her book Composition as a Human Science makes this same point. She has an excellent critique of scientism and positivism in her first chapter, and she also contrasts that method of research and knowing with what she calls "human sciences." She looks to hermeneutics, to interpretation, as a generator of understanding (rather than knowledge as fact) and develops a "third way" with fairly elaborate sources and arguments.

So we come back to this question: What are we after learning or knowing through research? What can we go after through research of language and teaching? By what methodologies will we guide our research investigations? How do we study these open, complex systems? While I can't definitely say what the alternative is, it seems clear that a hypo-deductive method, a test for cause-effect approach, a study premised on mechanistic, closed system assumptions would be in appropriate for studying reflection. It would be doomed for failure.

Wednesday, February 27, 2008

The Skills Debate

from a post to my 5365 class wiki in response to Deanna's post about a chapter by Lil Brannon on functional and critical literacy titled "(Dis)Missing Compulsory First-Year Composition" in the collection edited by Joseph Petragalia Reconceiving Writing, Rethinking Writing Instruction



This is a great post Deanna, and I think your summary of Brannon's chapter is really interesting. Knoblauch and Brannon did some great work in the 1980s-90s. Brannon is still around at UNC I think. I saw her at NCTE year before last. I want to add some perspective on the functional and critical literacy debate or we could call it skills vs critical literacy. Brannon's wonderful quote ("Limiting literacy to grammatical competence and designing a sequential curriculum based on the mastery of skills, although it appears streamlined, efficient, and accountable, does not offer students insight into how writers and readers actually use those abilities when composing") is exactly the argument that James Moffet makes in Teaching the Universe of Discourse. He uses the dynamic between "structure" and "substance." His use of those terms is rather complex, but one is dynamic and the other static (substance as skills). He basically is saying that because writing is an activity--not a subject--we need to learn it by doing the activity. Engaging in the dynamics of this activity is the only and best way to learn it. He is clear in his rebuttal of turning English into a subject like biology or history with a lot of facts and content to learn. Such learning turns the structure of discourse into a substance, in his words. I'm not doing a good job of summarizing Moffett. Looking back at chapter 1 in his book, I see how radical his position is and how the awareness of that position is nearly gone now. Let me quote a bit from him:

"How much is teaching English a matter of covering content, and how much a matter of developing skills, which are independent of any particular matter? Frequently, the dilemma has been resolved by claiming that certain contents are essential to learning skills. That is--to write one must know, as information, certain linguistic codifications and facts of composition; to read literature, one must be told about prosody and 'form.' But learning 'form' this way is really learning content, and the result is quite different than if the student practices form or feels it invisibly magnetized the whole curriculum. Learning and learning how to result in very different kinds of knowledge"(3).

Sorry for the long quote, but I think it is worth it because this is an old and large debate. Plato in the Phaedrus debates whether rhetoric is an art or a science. Cicero, too, debates it and you find Aristotle discussing it. I think they were talking about the same issue of how we learn to write or speak or in larger terms to effectively use language. Is this linguistic action a SUBJECT (techne) that we can codify and determine as knowledge? Or is it predominantly an art, and activity (dynamis). Aristotle in the beginning of the Rhetoric comes out and says it most certainly is a "subject." We can study the speeches of effective rhetors and codify and systemitize what they have done. However, classical rhetors are also clear that rhetoric or communication can't be reduced to rules--it is an art (let me admit, I am a bit fuzzy on these debates because it has been a while, but they seem to bounce around with their terms probably due to translation between rhetoric as art or science). By "art" I mean a capacity of excellence in activity. It is how well you perform the action. What is "tennis" by comparison? Is it an academic subject we can study and be tested on? Or is it an activity? Well, we could study tennis and read a lot of books about it, and it might help us play a bit better. However, tennis predominantly is an activity, it is an action, an engagement of skills not an abstract knowledge of those skills.

So the question is how do you get better at tennis, or communication? Do you first need to learn skills (the basics) before you can engage in the activity? How do you learn the activity?

Petraglia is pretty engaged with post-process notions of writing and communication coming from Thomas Kent who has the position that writing is unteachable. Hah! The post-process position is a rather extreme one that privileges writing as an activity and that the contingencies of communication and context are so great that no fixed knowledge of writing is of any use in these contingent situations. They use horrible terms like paralogic hermeneutics. Ugg. My critique of their position is that we always position ourselves within each situation by an adaptation or interpellation between what we "know" and the specifics of this particular context. It is the dialectic between theory and practice. Theory represents abstract "knowledge" that we have to apply within particular situations by our practice. The post-process folks would pull the rug out from under any notion of "knowledge" or abstract theory. At least that's my reading. Postmodern critics discuss ideas of "dangling phronesis." That is, practical wisdom--the meeting of specific situations in a fitting and ethical way--comes from no fixed "foundational" basis. It is all a game, made up to fit the moment and the specific context.

However, phronesis (the high art of wisdom behind any action, including writing) is not in my opinion dangling. We form our judgments on the basis of something. Which brings us back to skills! Do we need to "know" certain skills before we are able to engage in an activity effectively? Do we learn these skills independent of the activity? Plato interestingly in the end of the Phaedrus resolves that there are some "preliminaries of the art" that must be known before one becomes an effective rhetor. Cicero believed that only the most learned and wise person could have the knowledge to become an effective rhetor. Moffett and Ann Berthoff critize the developmental model of skills development. For instance, they don't think much of the notion that the way to learn to write is incrementally-- learn parts of speech, grammar, sentence, then paragraphs, and finally full essays. Most of the Developmental English textbooks have this developmental model (Paragraphs to Essays!). Bertoff says the flaw in this argument is that people apply a model of how we learn motor development to linguistic development. Language is not like learning a motor skill. We don't learn to "make meaning" by learning how to construct a sentence first. She would say that we learn to write better sentence as we make meaning.

As far as this debate about skills and "skills acquisition," I am on the side of both/and rather than either/or. I believe with Plato that a degree of knowledge about the preliminaries of the art is essential, but I also believe that this knowledge needs to be gained from engagement with the activity. It should be a mix. Grammar instruction, for instance, should be anchored in the students own writing. But it doesn't hurt to study and "know" a bit about some rules about comma usage for instance. This "study" should be intertwined with their activity of writing, though--not separated from it in extensive grammar worksheets or drills.

Where I am less sure about skills and skills acquisition is in the early years. I have watched my sons get hammered with learning particular "facts" about language such as phongrams or spelling or parts of speech, worksheet after worksheet. Is their eventual skill in writing based upon building this foundation of skills and knowledge? Are we able to talk about the "art" of writing or talk about strategies of composing only when these skills and bits of knowledge are in place? How does our curriculum and theory of learning grow from what students have done throughout their school years?

Thanks for baring with my long post...

Lennie

About Writing

Writing is always more precise and less precise than our thoughts: that is why our writing pieces glow with being and beckon with the promis...