November 10, Class Notes

Signal v. noise: "Our ability to tease the signal from the noise has not grown nearly as fast. As a result, we have plenty of data but lack the ability to extract truth from it and to build models that accurately predict the future that data portends ... we are fooled into thinking that random patterns are meaningful; we build models that are far more sensitive to our initial assumptions than we realize; we make approximations that are cruder than we realize; we focus on what is easiest to measure rather than on what is important; we are overconfident; we build models that rely too heavily on statistics, without enough theoretical understanding; and we unconsciously let biases based on expectation or self-interest affect our analysis."

Peer review:
why do it?
what can it do?
what can I get from it?
responsibility of the reviewer?

advantages include:
practice questioning
gaining new perspectives, advice on our writing
potential for self-reflection and analysis
learn about new styles for communicating
adopting the teacher perspective (how to give helpful criticism)
form of assessments
find out what others in the field are thinking

concerns include:
worrying about how comments will be received
uncomfortable
need tact and thoughtfulness

Bracey reminders:

• show me the data
• do the math
• are groups/situations comparable? (the value of context/ecology of schools)
• beware simple explanation for complex phenomena
• correlations are not causations (what else might account for the outcomes?)
• ask 'so what?'

Statistical v. practical significance - p <.05
Even if a study is proven effective, is it worth implementing?

Identity claims

Validity claims

• objective (visual)
• subjective (philosophical)
• normative (cultural)

****************************************************
For our next class, please read the first three episodes of Mr. Palomar ("Mr. Palomar at the beach").   Some suggestions to answer the question,"how should I read Mr. Palomar?" follow.  Please contact me for further in depth discussion.

Focus on how validity claims and truth conditions structure the experience of Mr. Palomar.  Think of his escapade as data gathering and reflection on the data he gathers.  Why does he find what he does?  Consider what conditions - subjective and normative - lead him to see an objective condition.  There will be a constant interplay between which validity claims are backgrounded (tacit, taken-for-granted, implicit) and the conditions that lead Mr. Palomar to meaning.  Help the class poke around with that process to get inside his understanding of the scene.

Focus on the similarity between what Mr. Palomar experiences and your experience in the classroom.  Granted, the comparison will not be exact.  Yet the struggles he has to make sense of his experience do mirror in some way the struggles you may have in coming to understand your teaching.  Italo gifts him with a talent for problematizing his experience.  That skill plays out in every entry.  He turns what might otherwise seem ordinary into a cascading set of questions that fuel his thoughts on the data before him and of which he participates.  He is the ultimate example of a participant observer, making sense of his setting as he participates in it.  Echoes perk up here to

• van Manen: "... tactful acting I demonstrate unwittingly what I can do ... thoughtful reflection I discover what I can do ... my pedagogical nature ..." and to
• Schon: "... they must plunge into the doing, and try to educate themselves before they know what it is they're trying to learn ..."

Remember, the reading is structured to enable you all to make sense of research analysis.  The book is a vehicle for bringing out complexity, of making the invisible visible. What do you learn about perception from each entry?  What rings true in the questions Mr. Palomar asks and the situation his perceptions put him in?  How does examining Mr. Palomar in each entry alter how you process the experience in schools?  What now will you look for or how will you look?

Third Critique Editorial Teams

Teachers,

For your final article critique, you will be part of an editorial team.  Before your writing can be submitted to me (sent 'to print'), it must meet approval from the other members of your group.  When a finished critique comes to me it will have the meet the standards of excellence (why limit yourselves to 'proficiency') of the entire team.  In other words, each separate paper is, in a sense, a group production.

This process replicates how peer review works, more or less, in refereed journals.  As the editors of an issue, you will play the role of determining what writing you feel is worthy of submission.  I look forward to both your work and the discussion of the process.

Here are the teams:
Jessica - Corrie - Jeremy - Zach

Andrew - Kelsie - Rachel - Aimee

Jay - Jacob - Kelly


Please direct all questions and comments to me as they arise.  Thanks.

Class notes, M O29

Teachers,

Some thoughts and questions on our class tonight:

Bracey:
When is using the mean appropriate?  The median?  The range?
How do you know if groups, and the conditions of their learning, are comparable?

What do the statistics from assessments really tell us?  What else must a teacher include in order to get better interpretation of the data?

To answer Corrie question: School leaders are not 'stupid' for using standardized measures as evaluators of teachers.  They are efficient and frugal.  Tests have what is called 'face validity;' on their face, most people accept them as valid.  And, in a crude sort of way, they are.  Our discussion in class concerned the validity and reliability of their inferential statistics.  Most people do not (and can not) pay attention to inferential statistics.

Observations:
Eric Fischel, "Year of the drowned dog" - explanation

Fredric Remington, "Fight for the water hole" - explanation

When observing, do we impose a narrative upon a scene?
Is it possible to observe without judgment, or interpretation?
How does a new teacher both trust her growing instinct, yet remain skeptical and inquisitive into why she does what she does?

Class notes S O20

Teachers,

Notes and questions from today's class:

How do you move from should to do?
What moves knowledge into action?

What data/information about our teaching can we collect and analyze?
What are the contextual factors of our teaching for which that data has meaning?

What are our goals, objectives, aims, ends, philosophies (what do I want to achieve, to happen, to be learned)?
What effort am I willing to apply to reach my objectives?
If I am not reaching them, do I change my action or have  I changed my beliefs?

How do I change from a judgment stance to one of inquiry and reflection?

What keeps me from asking "what in the world is going on?"
How do I turn from seeking solutions to problems, to seeking better understand about what happened to know what problem to address (what are meaning problems)?

How much of the contextual factors do I need to understanding before I have 'enough' understanding to act/decision?

How often do I take the effort to reflect on what did happen?
What a claim valid (what leads to mutual understanding in communication)?
Do we share the same objective world (are we talking about the same thing)?
Do we share the same subjective world (do we mean the same thing)?
Do we share the same normative world (do base our actions on the same principles and norms)?

When does an experience and anecdote represent the general reality?

Class notes, S O6

Teachers,

Some questions that arose during our class this past Saturday.  Look for a set of posts related to the articles in the next few days.  Please share your thoughts, if they add to the learning.

Thanks.

article critiques

• What is the conversation in this area?  What are the current norms, expectation and accepted methodologies and evidentiary criteria?
• To whom is the research directed?  What are the expectations of readers of this journal?  How difficult is it to get published in this journal?  How does that level of ease or difficult affect the standards of evidence?
• What can I learn about this area?  How can the research change my assumptions, schema and understandings?
• I am reviewing the idea or the research on the idea?
• Is the research deductive (does it start with a belief and find evidence for that belief)?  Is the research inductive (does it start with the evidence and ground up to a more general theory about the collected data)?  Is the author an analyst of the data or an advocate for an idea?
• Do authors attempt to generalize their findings (universally true, true for all regardless of any context)?
• Do the authors attempt to prove/validate a theory or do they intend an exploration of a phenomenon?
• Do the authors attempt to make a policy recommendation or do they advise more research?  Does the population of participants support their intent?

data gathering

• Attention matters; how narrowly should I focus?  What do I miss?
• How much control do I have over my focus and attention?  How can I become more aware of what I am aware? How do I know I know what I know?
• Humans are pattern detectors; is what we perceive really there?  What do we ignore, miss, make invisible in order to detect that pattern?
• Do we detect a pattern because our identity demands it?  Are we willing to allow our worlds to be rocked?
• How do find the balance between focusing on the context and investigating the margins?
• How do we make the invisible visible?
• What assumptions do we make about another's experience?  To what extent do I attempt to position-take with that other person in order to understand their experience?
• What is working for me?  Why do I think so?  In other words, it 'works' to do what?

Bracey, chapters 1 and 2 for S O20

******************************************
"Position-taking" - the empathic and active self-distancing of our own feelings to see through the experience of another.  If, as van Manen claims, we are "fated to never be transparent to ourselves" and we need to "make thoughtful sense of the meaning the child's experience has for the child as well as for our adult view," how can we tell when our efforts at position-taking result in a confabulation of the other's point of view or a confirmation of what we expect and want the other's point of view to be?

John  Lloyd, tedtalk on the Invisible

Jonathan Haidt, on intuition and reasoning (from the NYTimes, S O7): "We effortlessly and intuitively “see that” something is true, and then we work to find justifications, or “reasons why,” which we can give to others.  Both processes are crucial for understanding belief and persuasion. ... And intuitions are rarely stronger than when they are part of our partisan identities ... But I never said that reasons were irrelevant. I said that they were no match for intuition, and that they were usually a servant of one’s own intuitions. Therefore, if you want to persuade someone, talk to the elephant first. Trigger the right intuitions first. "

Reading question: van Manen and Schon

Teachers,

As hoped for and promised, though a bit tardy.  As you read each article, please keep these questions as a guide:

Max van Manen, "Beyond assumptions"

• Why does van Manen begin his paper with the claim that there are no agreed upon techniques and procedures for action research?
• van Manen seeks "a more self-reflective human science-oriented form of action research while restoring the pedagogical quality of our relation to children." What does this imply about the forms of research typically undertaken by teachers?  Why would he want it to change?
• What impact does his claim that "theory enlightens practice after the action has occurred" have on self-reflection?
• What are "meaning questions," in contrast to improving pedagogy or problem-solving in classrooms?
• How might you investigate a teacher's "pedagogical thoughtfulness and pedagogical tact"?
• What might van Manen mean by "the way we make thoughtful sense of the meaning the child's experience has for the child as well as for our adult view"?
• What are the implications for data collection if "the most captivating stories exactly those that help us to understand better what is most common, most taken-for-granted, and what concerns us most ordinarily and directly in our tactful pedagogical interactions with children "?
• How are we to understand our decision-making and teaching practice if we are "not completely transparent to ourselves"?
• How can the research process enable you to find your "pedagogical nature"?

Donald Schön, "Educating the reflective practitioner"

• How does Schön argue for indeterminacy in professional practice?  Why does he do so?
• How does "technical rationality" contrast with "reflection-in-action"?
• What steps would you take to answer the question “what it is it that we do when we do what we do"?
• What kind of method and rigor is required for "reflection on reflection-in-action"?

Facts do not enlighten

Teachers,

An op-ed from the NYTimes confirms the view that reason is not a tool of truth-seeking, but rather one of argumentation.  Even 'facts' get disregarded: "You might expect that people’s views would soften and that divisions between groups would get smaller. That is not what usually happens. On the contrary, people’s original beliefs tend to harden and the original divisions typically get bigger. Balanced presentations can fuel unbalanced views ... What explains this? The answer is called “biased assimilation,” which means that people assimilate new information in a selective fashion. When people get information that supports what they initially thought, they give it considerable weight. When they get information that undermines their initial beliefs, they tend to dismiss it."

Biased assimilation acts to filter out what we neither expect nor want to hear.  Unfortunately, the 'wanting' occurs well below the level of cognitive awareness; we may not realize how selective our perceptive and cognitive processes are.