Friday, June 27, 2008

Pre-Dissertation Proposal



Pre-dissertation Proposal
Lennie Irvin
Ph.D. Student in Technical Communication and Rhetoric, Texas Tech University


Identify the Problem Requiring Research
The problem I propose to address with my dissertation research can be illustrated through the recent history of Freshman Composition at Texas Tech University. A number of years ago, between-the-draft reflections were included as a core component of the curriculum. After each draft and after each peer response, students were asked to reflect upon their piece of writing and what they might do to improve that draft for the next one. The activity was included in the curriculum based upon the belief that such reflections helped students develop a critical self-awareness and thus greater control of their own writing activity. In Fall 2007, however, these between-the-draft reflections were taken out of the curriculum. They were seen to have no significant benefit and to be extra work on already overloaded students (and graders). The decision was based upon a belief that students wrote these reflections without engagement and without effect upon their practice or end product.

This back and forth inclusion and exclusion of such in-task reflection speaks to the problem surrounding this pedagogical activity. We don’t know enough about what happens for students as they reflect or about its possible influence on students’ writing and learning within a Freshman Composition class. We don't have a theory that adequately explains and describes what happens for students as they reflect in this way, so that this pedagogical exercise can be used effectively in the classroom. This dissertation study proposes, then, to address this problem by using grounded theory and comparative analysis of student writing and reflections within Freshman Composition to generate such a theory.

The Research Questions focusing this study are:

How do teacher-prompted rhetorical reflections performed by freshman students at TTU influence and related to students’ learning and writing practice?

Can a comparative analysis of teacher-prompted rhetorical reflections generate a theory to explain and describe what happens when students engage in this activity?


Definition of terms:
“teacher-prompted rhetorical reflection” refers to a pedagogical activity when a teacher asks a student to reflect upon their writing and writing performance between drafts. The term “rhetorical reflection” designates the in-task nature of reflection and is defined more clearly later.
“learning” refers to a change and growth in thinking and practice experienced by the learner.
“comparative analysis” is a method of textual analysis used in grounded theory to generate theory.

Review Some of the Basic Literature Regarding the Problem

Jennifer Moon in her book Reflection in Learning & Professional Development (1999) offers a comprehensive definition of reflection and its place in learning: "reflection itself is a mental process with purpose and/or outcome. It is applied in situations where material is ill-structured or uncertain in that it has no obvious solutions, a mental process that seems to be related to thinking and to learning" (5). What distinguishes different kinds of reflection is not the process or nature of the reflection, but the "framework" or purpose to which it is used: "it is the framework of intention and any guidance toward fulfillment of that intention that is significant in distinguishing one act of reflection from another. The mental process itself may not differ from one situation to another" (15). My own understanding of reflection is rooted in Moon’s comprehensive definition.

I want to provide a broad overview the various frameworks of reflection discussed in multiple disciplines, and then direct my discussion toward how reflection is mainly understood in Composition Studies.

Philosophic View of Reflection
What I am calling the philosophic view of reflection refers to how it is seen as a form of judgment or wisdom that can flexibly apply general principles to specific contexts. This form of judgment resembles what Aristotle would call phronesis. Immanual Kant (1790), Gadmer (1975), Farrell (1993), Phelps(1988), King and Kitchener and their Reflective Judgment Model (1994), and even Rand Spiro’s (1992) notions of “cognitive flexibility” represent thinkers that fit this philosophic view towards reflection.

Reflection for Emancipation
The central thinker for this kind of reflection is Jurgen Habermas who approaches reflection as a tool to develop particular forms of knowledge—specifically, a broader awareness and truer understanding with the goal of freeing one from previous thinking or situations. This form of emancipatory reflection is central to “critical theory” and its goal of revealing oppressive constructs in order to change them. This school of reflection since it is often applied in political, social, or psychological areas rather than in education.

Reflection and Learning
John Dewey is probably the central thinker who discusses the importance of reflection for learning and problem-solving, and his definition of reflection has been the dominant understanding of reflection within education in the 20th century. Dewey defined reflection as “active, persistent and careful consideration of any belief or supposed form of knowledge in light of the grounds that support it and the further conclusions to which it tends” (9). As Jennifer Moon describes, “Dewey’s more detailed analysis of reflection rests on interpretive interests, in ‘making sense of the world’ in the process of effective education” (15). His emphasis on problem-solving and strategizing connects with a large school of reflection and experiential learning focused around David Kolb’s “experiential learning cycle” which contains “reflective observation” as a key part of the learning cycle. The writing process can be viewed as an experiential cycle with reflection placed within each iteration as an activity to generate understandings and abstract concepts to guide the next draft. Jennifer Moon’s “map of learning” positions reflection as needed for an “upgrade” of learning as a learner progresses up the “stages of learning” (154). Jack Mezirow’s notions of reflection and what he calls “Transformational Learning” are also significant. In his view reflection is a form of validity testing that leads to transforming “meaning schemes” (specific attitudes or beliefs) or “meaning perspectives” (sets of meaning schemes) (101).

Reflective Practice
Another school of reflection focuses on the “reflective practitioner.” Donald Schon’s (1983, 1987) notions of “reflection-in-action” and “reflection-on-action” have been enormously influential in the areas of professional development, such as medicine, business, and teacher education. George Hillock’s book Teaching Writing as Reflective Practice represents one important example in the field of writing. This kind of reflection focuses predominantly on generating the moment-by-moment capacity for effective practice (similar to practical wisdom or phronesis).

Views of Reflection in Composition
Within Composition Studies, reflection has been used following two main frameworks or purposes. I have labeled these two purposes as “curricular” or “rhetorical,” and they can be understood by describing them according to the three poles of reflection.



Curricular reflection is defined as post-task, retrospective reflection done predominantly to construct and demonstrate learning for an audience (often a teacher for the purpose of evaluation). Yancey (1998) in her book Reflection in the Writing Classroom calls this type of reflection “Reflection-in Presentation.” It is typically performed at the end of a unit, or at midterm, or at the end of a semester. Within Composition Studies, this type of reflection has predominantly occurred in reflective letters accompanying end-of-course portfolios, and most scholarship about reflection has focused on this type of reflection (Yancey, 1997, 1998; Black, Sommers, and Stygall, 1994; Hamp-Lyons and Condon, 1993, 2000; Camp, 1998). Additional scholars on this “reflection for learning” or constructivist view of reflection in Composition include Gleason (1993), Hughes and Kooy (2002), Brown (1998), Qualley (1997), J. Sommers (1989), Perl (1980), and Underwood (1998). Another aspect of “curricular reflection” is its role in the transfer of knowledge and skill. My study will concentrate on reflection inside the activity of writing, not its affect outside of it.

My focus in this dissertation research will be on the second type of reflection considered in Composition Studies--what I am calling “rhetorical reflection.” Rhetorical reflection is defined as in-task reflection done between drafts predominantly for a writer’s own purposes of validity testing or problem-solving within the activity of writing. The dominant theorist and researchers of reflection or metacognition within the writing process are Flower and Hayes and their cognitive process theory of writing (1981). Their work, along with research into the psychology of writing done by Bereiter and Scardamalia (1987) and many others, has continued to be a basis for our understanding and study of writing (as attested to by two recent collections by Alamargot and Chaquoy (2001) and Allal, Chanquoy, and Largy (2004)). In their various models, reflection as a form of reviewing and monitoring comprises a significant part of the cognitive operations of composing. Another closely-related concern in Composition to reflection has been attention paid to student self-evaluation or self-assessment, particularly as it applies to revision. These between-the-draft, prompted activities of self-evaluation are extremely similar to my focus on rhetorical reflection (N. Sommers 1992). Chief scholars and researchers on this kind of self-evaluation in Composition include Beach (1976, 1980, 1984), Haswell (1993), Moore (1993), Anson (2000), Harris (2003), and Yancey (1998). Most argue that this kind of self-evaluation is crucial for helping students write and revise better.


What a preliminary investigation into research on rhetorical reflection shows:
(from 29 research or research-related articles; not all studies refer to writing)

"Deep reflection" correlates to better performance
A number of studies conclude that better or more sophisticated reflection leads to better performance (whether that was writing performance or teaching skill). Anson (2000) finds a relationship between writer's proficiency and their blending/shifting of "function in scheme" (i.e. more sophisticated reflective thinking). Likewise, Ellis (2005) sees a "cohesive" conception of writing (revealed in reflections) with a deeper approach to writing. Each also notes that more surface or less sophisticated sorts of reflection reveal less proficiency. Each is noting a correlation between deeper reflection and better performance. The other studies that follow this general conclusion are Higgins (16), Kennison (2006), and Yeo (2006). The larger question is--what significance does this correlation mean?

Reflection is a tool for meaning formation/negotiation, contextual knowledge and action
Implications from three studies--Flower (1994), McAlpine (1999), and Peck (1989)--suggest that reflection has a significant role to play in the formation and negotiation of meaning and action. This conclusion or assumption seems to relate closely to the previous convergence on "deep reflection."

The importance of the affective or emotional in reflection
Studies done by Efkides (2006) and Shapira (2005) highlight the important role affect or feelings and emotion have in impacting reflective judgment. Shapira's research is interesting because she concludes that "affective strategies" have the most important influence on improving writing quality and confidence.

A complicated link between reflection and revision
Studies done by Rijlaaradam (2004) and Peck (1989) highlight the difficulties in connecting what happens in a reflection and what ultimately happens in a revision. These researchers caution against making a clear cause-effect connection.
Measuring reflection
Multiple studies use some sort of coding scheme to evaluate reflective texts for analysis that could be prototypes for an eventual coding scheme I could use for my analysis of reflections. Anson (2000), McAlpine (1999), and Raphael (1989) probably have the best coding schemes. Beach (1976) and Yancey (1998) are also excellent, but they are evaluating self-evaluation texts (roughly equivalent to reflections). Yancey has a scheme similar to Anson’s, and Beach's is interesting because he presents results on productive self-evaluations that could then be used as the basis for forming a coding scheme. The one critical voice regarding the measuring and analyzing of reflections is Sumsion (1996) who strongly disagrees with the quantitative measurement of reflection (however, she bases this conclusion on a suspect study of her own).

What is the gap in our understanding of reflection in Composition?
We actually have an incredibly rich theoretical understanding of reflection. The large gap I see in our conception of reflection at this time within Composition Studies is fully appreciating the link between reflection and invention (that is reflection’s epistemic and transformative role in learning and writing practice). So much attention is paid to post-task reflection for the purpose of assessment, the self-construction of learning, and transfer that this other form of Deweyian, problem-solving reflection has not received the attention it deserves. It is my contention that reflection strategically applied within the activity of writing heuristically reactivates the concerns of invention (namely, the full concerns of the writer’s “rhetorical stance”) with a beneficial influence on the writer’s performance and learning. The cognitivist have identified reflection or metacognition as a significant mental activity applied within their model of the activity of writing, and research has identified a correlation between “deep reflection” and better performance, but empirical research has not developed a theory to understand the features of this deep reflection in terms of writing, rhetorical stance, and invention.

Outline Goals and Methods of Research for Adding to the Knowledge Regarding the Problem

To fill this gap in our understanding of rhetorical reflection as a pedagogical activity, I propose studying the writing and reflective texts produced by Freshman writers within the First Year Writing Program at Texas Tech. My study will be an archival study examining texts within the TOPIC database from the academic year 2004-2006, which contains thousands of these texts. This data set offers the unique opportunity to study thousands of texts both through textual analysis, but also through datagogic methods of data-mining. Datagogic within Composition Studies refers to the use of databases as a central site where all writing is submitted in a writing course. “Datagogic methods” refers to new methods of researching writing within this new database setting.

According to Glaser and Strauss (1967), this dissertation research would be considered a beginning step in generating theory. They believe the initial establishment of catagories and properties are best established by first minimizing differences among the comparison groups (55). My data set of freshman writers of roughly the same age from the same school represents such a “minimized” group. Only after these categories and properties are established within this relatively homogeneous set of groups should the researcher turn to “maximizing” the differences among comparative groups to further refine and develop the theory. This direction toward maximizing differences among comparison groups points to a possible post-dissertation research agenda.

The first phase of my research will be to do this basic work of generating theory within a minimized group (TTU Freshman Composition, TOPIC). Glaser and Strauss state two criteria for the generation of theory. The theory generated must “fit” the situation and “work” when put to use: “By 'fit' we mean that the categories must be readily (not forcibly) applicable to and indicated by the data under study; by 'work' we mean that they must be meaningfully relevant to and be able to explain the behavior under study” (3). The second phase of my research will engage in confirmation of the fitness and workability of the theory generated by engaging in Content Analysis of a large sample of student writing from TOPIC as well as strategic data mining within the TOPIC database.


The following chart derived from Creswell (2003) will describe my general research design:
Research Approach
Qualitative

Knowledge Claims (epistemological stance)
Constructivist

Strategies of Inquiry
(methodologies) Grounded theory

Methods
Comparative Analysis of texts
Additionally, possible Content Analysis and data-mining
Sample/Sampling Theoretical sampling of various groups of Freshman writers and writing from within the TOPIC database. In theoretical sampling, the process of data collection is controlled by the emergence of theory.

A second phase of the study to verify the discovered theory might entail Content Analysis and data mining Data Analysis Close textual analysis of texts will be used following grounded theory's method of comparative analysis.

From this comparative analysis, derive a coding instrument for analyzing these reflections by a team of coders. Identify key search parameters for large-scale data mining.

My research process as I see it right now might follow this path.
1. Use grounded theory to discover categories, properties, and their interrelation and generate a theory
2. Derive a coding instrument from this grounded theory analysis
3. Apply this coding instrument to the content analysis of a sample of texts to check the understandings derived from the grounded theory analysis
4. Use large-scale data-mining analysis to further triangulate some of the understandings coming from the previous research efforts


Outline of Chapters
I. Introduction: The Rationale for Studying Rhetorical Reflection
II. Literature Review on Reflection in Learning
III. The Connection of Reflection to Invention
IV. Methodology and Methods for Research Study
V. Results from Study
VI. Implications for Practice

Explanation of Reading List Materials and Their Relation to the Dissertation Research
The scholarship contained in my reading list will contain four broad categories: reflection, invention, composition/rhetoric and rhetoric, and research methods. Since the focus of my inquiry is on reflection, the bulk of my reading list will contain readings related to reflection. These readings will contain general scholarship on reflection, reflection in education, and reflection within Composition/Rhetoric. Since reflection is so often linked to learning, this section may contain theories of learning that are applicable to reflection. Invention is added as a special category in my reading list because I believe there is a link between reflection and invention, especially as it relates to a writer negotiating their rhetorical stance within the activity of writing. The third category will present foundational text within the field of Composition/Rhetoric as well as in Rhetoric. I don’t propose to present a laundry list of Composition and Rhetoric text, but I will include texts which have been significant in my understanding of writing and rhetoric. The last category will deal with research and research design. Although I will present some foundational texts for researching (such as MacNealy (1999) and Johanek(2000)), I will also include texts focused directly on the methodologies and methods I will use in my study, particularly Grounded Theory.

Works Cited
Alamargot, Denis and Lucile Chanquoy. Through the Models of Writing. Dordrecht: Kluwer
Academic Publishers, 2001.
Anson, Chris. "Talking About Writing: A Classroom-Based Study of Students' Reflections
on Their Drafts." Self- Assessment and Development in Writing: A Collaborative Inquiry. Ed. Jane Bowman and Kathleen Blake Yancey. New Jersey: Hampton Press, 2000. 59-74.
Beach, Richard. "Self-Evaluation Strategies of Extensive Revisers and Nonrevisers." CCC
27.2 (May 1976): 160-64 pp. 2 Aug. 2007.
---. "The Effects of between-Draft Teacher Evaluation on High School Students' Revising of
Rough Drafts." Research in the Teaching of English 13 (1979): 111-19.
Beach, Richard and Sara Eaton. "Factors Influencing Self-Assessing and Revising by College
Freshmen." New Directions in Composition Research. Ed. Richard Beach and Lillian S. Bridwell. vols. New York: The Guilford Press, 1984.
Bereiter, Carl and Marlene Scardamalia. The Psychology of Written Composition. Hillsdale:
Lawrence Erlbaum Associates, 1987.
Black, L., Daiker, D. A., Sommers, J,.& Stygall, G. (Eds.). (1994). New Directions in Portfolio
Assessment. Reflective Practice, Critical Theory, and Large-scale Scoring. Portsmouth, NH: Boynton/Cook Publishers.
Brown, William. "Power of Self Reflection through Epistemic Writing." College Teaching
46.4 (Fall 1998): 135-8 pp. San Antonio College Library. 25 April 2002.
Camp, Roberta. "Portfolio Reflection: The Basis for Dialogue." The Clearing House 72.1
(Sep/Oct 1998): 10-12 pp.
Creswell, John W. Research Design: Qualitative, Quantitative, and Mixed Methods. 2nd ed.
Thousand Oaks: Sage Publishing, 2003.
Dewey, John. How We Think. Boston: DC Heath, 1933.
Efklides, Anastasia. "Metacognition and Affect: What Can Metacognative Experiences Tell
Us About the Learning Process?" Educational Research Review 1.1 (2006): 3-14 pp. 15 July 2007 .
Ellis, Robert, Charlotte E. Taylor, and Helen Drury. "Evaluating Writing Instruction through
an Investigation of Student's Experiences of Learning through Writing." Instructional Science Spring 33 (2005): 49-71.
Farrell, Thomas B. Norms of Rhetorical Culture. New Haven, CT: Yale University Press,
1993.
Flower, Linda and John R. Hayes. "A Cognitive Process Theory of Writing." College
Composition and Communication 32 (1981): 365-87.
Flower, Linda. The Construction of Negotiated Meaning: A Social Cognitive Theory of
Writing. Carbondale: Southern Illinois Press, 1994.
Gadamer, Hans-George. Truth and Method. New York: Seabury, 1975.
Habermas, Jurgen. Knowledge and Human Interest. London: Heineman, 1971.
Glasser, Barney G. and Anselm L. Strauss. The Discovery of Grounded Theory. Chicago: Aldine Publishing Co., 1967.
Gleason, Barbara. "Self-Reflection as a Way of Knowing.Phenomenological Investigations in
Compositions." Into the Field: Sites of Composition Studies. Ed. Ann Ruggles Gere. vols. New York: Modern Language Association, 1993.
Hamp-Lyons, L., & Condon, W. Assessing the Portfolio. Principles for Practice, Theory, and
Research. Cresskill: Hampton Press, 2000.
Hamp-Lyons, L., & Condon, W. (1993). Questioning assumptions about portfolio-based
assessment. College Composition and Communication, 44(2), 176-190.
Harris, Joseph. "Revision as a Critical Practice." College English 65.6 (July 2003): 578-92.
Haswell, Richard H. "Student Self-Evaluations and Development Change." Student Self-Evaluation: Fostering Reflective Learning. Ed. Jean MacGregor. San Francisco: Jossey-Bass Publishers, 1993. 83-100.
Higgins, Lorraine, Linda Flower, and Joseph Petraglia. "Planning Together: The Role of Critical Reflection in Student Collaboration." Written Communication 9.1 (1992): 48-84.
Hillocks, George. Teaching Writing as Reflective Practice. New York: Teachers College
Press, 1995.
Hughes, Herman Woodrow, and Mary Kooy. "Dialogic Reflection and Journaling." The
Clearing House 70.4 (Mar/Apr 1997 ): 187 pp. San Antonio College Library. 13 May 2002.
Johanek, Cindy. Composing Research: A Contextualist Paradigm for Rhetoric and
Composition. Logan: Utah State University Press, 2000.
Kant, Immanuel. Critique of Judgment. Trans. Werner S. Pluhar. New York: Hackett, 1790.
Kennison, Monica. "The Evaluation of Students' Reflective Writing for Evidence of Critical
Thinking." Nursing Education Perspectives 27.5 (Sep/Oct. 2006): 269-73.
Kolb, David A. Experiential Learning: Experience as the Source of Learning and
Development. New Jersey: Prentice Hall, 1984.
King, Patricia M., and Karen Strohm Kitchener. Developing Reflective Judgment. San
Franscico: Jossey-Bass, 1994.
MacNealy, Mary Sue. Strategies for Empirical Research in Writing. New York: Longman,
1999.
McAlpine, L., et al. "Building a Metacognitive Model of Reflection." Higher Education 37
(1999): 105-31.
Mezirow, Jack. Transformative Dimensions of Adult Learning. San Francisco: Jossey-Bass,
1991.
Moon, Jennifer A. Reflection in Learning & Professional Development. London: Kogan
Page, 1999.
Moore, William S., and Steve Hunter. "Beyond 'Mildly Interesting Facts': Student Self-
Evaluations and Outcome Assessments." Student Self-Evaluation: Fostering Reflective Learning. Ed. Jean MacGregor. San Francisco: Jossey-Bass Publications, 1993. 65-82.
Peck, Wayne C. "The Effects of Prompts Upon Revision: A Glimpse of the Gap between
Planning and Performance." National Center for the Study of Writing and Literacy Techinical Report No. 26. May 1989. 15 July 2007. .
Perl, Sondra. "Understanding Composition." College Composition and Communication 31.4
(Dec. 1980): 363-69 pp. San Antonio College Library. 25 April 2005.
Phelps, Louise Wetherbee. Composition as a Human Science. Oxford: Oxford University
Press, 1988.
Qualley, Donna. Turns of Thought: Teaching Composition as Reflexive Inquiry.
Portsmouth: Boynton/Cook, 1997.
Raphael, Taffy E., Carol Sue Englert, and Becky W. Kirshner. "Students' Metacognitive
Knowledge About Writing." Research in the Teaching of English 23.4 (1989): 343-79.
Rijlaaradam, Gert, Michel Cousijn, and Huub Van Den Bergh. Revision: Cognitive and
Instructional Processes. Boston: Kluwer Academic Publishers, 2004.
Shapira, Anat, and Rachel Hertz-Lazarowitz. "Opening Windows on Arab and Jewish
Children's Strategies as Writers." Language, Culture, and Curriculum 18.1 (2005): 72-91.
Schon, Donald A. Educating the Reflective Practitioner. San Francisco: Jossey-Bass
Publishers, 1987.
---. The Reflective Practitioner. San Fransisco: Jossey-Bass, 1983.
Sommers, Jeffrey. "The Writer's Memo: Collaboration, Response, and Development."
Writing and Response: Theory, Practice, and Research. Ed. Chris M. Anson. vols. Urbana, IL: National Council of Teachers of English, 1989. 174-86.
Sommers, Nancy. "Between the Drafts." College Composition and Communication 43
(1992): 23-31.
Spiro, R.J., Feltovich, P.J., Jacobson, M.J., & Coulson, R.L. “Cognitive flexibility,
constructivism and hypertext: Random access instruction for advanced knowledge acquisition in ill-structured domains.” Constructivism and the Technology of Instruction. Eds. T. Duffy & D. Jonassen. Hillsdale, Erlbaum: 1992.
Sumsion, Jennifer, and Alma Fleet. "Reflection: Can We Assess It? Should We Assess It?" Assessment & Evaluation in Higher Education 21.2 (1996): 121-31.
Underwood, Terry. "Teaching Writing with Reflective Questions and Reflective Events
(Reflective Classroom Culture as a Part of the Portfolio Process)." The Clearing House, Sep-Oct.1998. 1-9. Vol. 72.
Yancy, Kathleen Blake. Reflection in the Writing Classroom. Logan: Utah State University
Press, 1998.
---. (1998). Reflection, self-assessment, and learning. Clearing House, 72(1), 13-18.
Yancey, K. B., & Weiser, I. (Eds.). (1997). Situating Portfolios. Four Perspectives. Logan, UT:
Utah State University Press.
Yeo, Roland K. "Learning Institution to Learning Organization: Kudos to Reflective
Practitioners." Journal of European Industrial Training 30.5 (2006): 396-419.

6 comments:

Lennie said...

Just a brief comment on this draft. I believe it represents a middle text on my way to accommodating or adjusting my study to a study to "generate" theory. What is missing is the need for generating theory? What has been done before that this will be different from and perhaps better?

I don't have the narrative, the story down yet. My review of the literature on the problem is just a review of the literature on reflection. I suppose I need to shift this recounting of the theory to be a narrative of concepts about reflection built from experience and logical deduction. Or we could also say a kind of interpolation of this "common sense" theory to writing, but we haven't build an understanding from the ground up.

Anonymous said...

Reflection? Try to understand how to study. See the new book on amazon.com: "Teaching and Helping Students Think and Do Better".

John Tenny, Ph.D. said...

A practitioner's response:

I'm the retired (ha!) director of the Willamette University School of Education where I gave numerous assignments for student/student teachers to 'reflect' on either what they saw in a observation of another teacher or on their own practice as a student teacher. Our program was heavy in requiring reflective tasks. From that experience comes this caution - the reflective practices of your students may not be done under the same definition you are proposing. If I use hindsight to define reflection as used by the vast majority of our students, it was to describe what they saw or remembered, with a cautious evaluative conclusion.

Again in hindsight, I don't think the faculty had a clear definition of reflection, certainly not a common one, and I don't believe, based on the outcomes, that we make the task of reflection clear to the students.

As I 'reflected' on my career in teacher education (reviewing what I had done, what was effective/not effective, identifying a central theme to my practices, and what I would change were I to start over) - my post retirement definition that I wish I had used with students - I concluded that my efforts to improve their teaching skills through praise, criticism, and offering of various solutions to their teaching problems was largely ineffective. It wasn't until I took a more objective role in observation/evaluation that I found success, both in the depth of teacher reflection and in effective change in teaching practices.

I found that when I shifted from feedback in the form of anecdotal notes to providing objective data on what was happening in the classroom, the students/student teachers shifted from a defensive/deflective or accommodative response to one of independent reflection (definition above), problem solving, and change.

In my now failed retirement, and initially as a mental exercise, I developed the Data-Based Observation Method and then wrote a software program to support it. The software is not necessary, but make it much easier.

In the Data-Base Observation Method the focus of an observation is collaboratively determined between observer and observee - "What do you want to know about your classroom?". Guiding questions can be used to focus the process on categories such as content delivery, class management, student relations, etc. Once the focus has been determined, the observer will gather objective frequency and duration data on classroom behaviors of teacher and/or students.

Here's where the reflection come in. The data is provided to the teacher with these questions "Is this what you thought was happening in your classroom? Is a change needed? If so, what will you change?" When this external, objective picture of what had happened in their classroom (part one of my definition - reviewing what I had done) is presented, the teachers make the determination of whether the teaching/learning was effective/not effective (part two of the definition).

Professional level discussion ensues, based on the objective data, to determine if and/or what changes should be made (part four of the definition - part three, identifying a central theme, comes after a number of the data-based discussions).

There now has been five years of implementation of this method by me, school administrators, and peer coaches and I have found that it builds the skill of reflection in teachers, a skill I am coming to see as a critical element in becoming a long-term successful teacher. I believe that 'reflection' is shallow and surface when the person does not have the factual basis for understanding what occurred and when the reflective task is to be either self or externally evaluative in nature. The question is not "How did I do?" (Answer: good, poor, passed, a 6 out of 10, I liked it, etc), but "What happened and was it effective?"

There's more about the Data-Based Observation Method on my blog Data-Based Classroom Observation and my website eCOVE Software.

Peace, John

John Tenny, Ph.D. said...

Lennie

I also think there is a difference between reflecting for internal versus external purposes. My experience has been that in any evaluative setting (instructor/student, administrator/teacher, even mentor/new teacher) the power dynamic has a significant impact on how the observee is able to respond. 'Reflections' in these cases always have one foot in the 'what does he want/does he approve' camp and do not pursue the deep reflection.

An example of the use of data and building reflection: I have a friend, Ph.D. and good presenter, who was presenting at a conference. I sat in and created at tool to track where she focused during her presentation. She was using a laptop with a powerpoint, and had paper notes. During the presentation she talked to the audience 68% of the time; looked at her notes 9%, looked at the computer 5%, look at the screen 7%, and had audience participation 11% of the time.

After the session I showed her the data and her response was "Is that good?" (had never had a factual basis from which to judge before this). My response was "Is this what you though you were doing?"

The reaction was very interesting. She looked up into the air for a minute (I believe reviewing her past presentations and her definition of a satisfactory presentation) then said "That's more audience presentation time than I thought there was. And if I were to get a remote to control the slides, I wouldn't need to go to the computer to change slides. I'd like to increase the audience participation even more."

My interpretation is that the data gave her the foundation from which to form her own assessment and to compare it against her personal model for good presentations. From there she was able to form a plan for improving the presentation -- all her own, not in response to extrinsic motivation.

As I work with teachers, I find that they are not uniformly adept at reflecting, even when provided data. Some look, as the example above, for either an external criteria or external approval. I also find that nearly all will quickly become engaged in personal reflection when presented the data in a neutral, non-evaluative manner. I was surprised to find how easy it has been to build reflective skills in teachers. Since we work with teachers outside of the 'evaluation cycle' and inside the professional development system, and are very careful to remain neutral in our language (don't praise, don't criticize, don't solve the problem), I think the method facilitates gaining the distance and perspective on themselves.

They do, in general, already possess the knowledge framework of what constitutes good teaching. Freshman would not likely be at that level.

Thinking about writing brings up another memory. I had taken several courses on how to write with a goal of improving my skills - I really wanted to be a good writer. In the last course I took, the instructor 'never praised, never criticized, and never gave a solution, in a response to my writing. Her comments on a paper were only comments such as "I was confused by this part. This sentence made me laugh. This passage made me angry." She provided only her personal (and factual) response to what I wrote. At first I was angry with her approach - how could I get better if she didn't tell me what I did wrong? Soon, however, I found my self focusing on her reaction to my writing, and in that one course found my voice. The confusing parts were most often sentence or paragraph structure, the emotional response were either what I wanted or confusing to me. That confusion led met to examine what I had written to see how someone else would find that disturbing or funny when I intended it to be just sad.

Again, by this time I had some knowledge base related to writing and my own goals. I would not have defined my reactions to her comments as reflection at the time, although I now think they were. That leads me to two thoughts: if one wants students to reflect according to a particular definition, they must first learn how that method/approach of reflection works. I strongly suspect that they would have a wide variety of operational definitions, and those would not be easy to overcome.

Second, I wonder if the act of reflection needs to be called 'reflection' for more than surface reflection to happen. If I say "Please reflect on...." the personal definition come in. If instead I ask "Is this what you thought was happening?" I get the process I have in mind. By examining a definition and determining the observable behavior that would be the result of operating under that definition, I can provide the objective guidance/feedback to the participant without the distracting filter of the personal definition of the term. That's what I do all the time when I align/create tools to support teaching standards and work with teachers.

Peace,
John

Altha Gaudet said...

What part of your dissertation is this? From the looks of it, it kinda looks already complete. Well, dissertation research should really be finish early to avoid cramming when the deadline comes. It would certainly help avoid mistake that can take up time on working again.

mayazoe said...

10 Tips on how you can lose weight now! Discover what foods to stay away from and what are your best choices. Learn the right way to start an exercise program.
homework in english

About Writing

Writing is always more precise and less precise than our thoughts: that is why our writing pieces glow with being and beckon with the promis...