Showing posts with label Relay. Show all posts
Showing posts with label Relay. Show all posts

Monday, June 1, 2015

Almost like being there?

Video is seductive technology. It’s used as click bait on social media, to advertise on the sides of buildings in Times Square, and even to help pass the time in the back seat of a New York City taxi. In education, video has tremendous potential to instruct, to inspire, to raise awareness, and more. It is making its way into teacher education as a tool for analyzing teaching. Despite its potential, I am concerned about some trends I am noticing, and that I believe deserve careful scrutiny.

For example, at Relay, the website boasts that its instructors are not “sitting in ivory towers” but coaching and mentoring students who are learning to become teachers. “When they’re not right there in the classroom, they’re side by side with our students, watching and analyzing video of them…pausing, rewinding and replaying the video to give pinpoint feedback.” They even call these videos “game film” as in show that you’ve got game in the classroom. Video is also used to instruct, and Relay’s site explains “our students can watch and rewatch course modules as they complete our program.” One of the students featured in a Relay video  even claims, “Film doesn’t lie.”

One of my concerns lies in the false sense of objectivity that is ascribed to videos of classroom life. Like it or not, the camera is a presence. You can’t be unaware of it, and it comes with its own interpretive lens even sitting on a tripod in the corner of the room. It is not reality, it is a representation of reality. What’s more, classroom events are often incredibly complex, and require deep contextual knowledge to fully understand and even interpret. I know from my own research in classrooms that when revisiting classroom events with participants using video there is a lot of unpacking to do about the teacher’s intentions and beliefs, the students’ understanding, and the shifts and gaps between what is captured in film and what is remembered by the people afterwards.

Another concern is that the temptation in observing teaching to satisfy a checklist of items you are looking for is exacerbated with video. We have been there, done that, and the behavioral checklist doesn’t work. It’s a bit like getting on a sightseeing bus, driving around a city, and saying you saw this and that. You caught a glimpse, grabbed a bad photo or two, but what did you really see? Not much. Using video to evaluate teaching is also problematic because the likelihood is that only a short clip will be analyzed, a tiny sliver of what classroom life is really like, and the evaluator will probably only watch once. It’s as if instead of going to the Metropolitan Museum of Art, lingering over favorite paintings and talking with a friend about what you notice, like, appreciate, wonder about, and so on, and reading the contextual information provided by the curator, you watch a quick slideshow online where each image lasts for 15 seconds and you get the name of the artist and the title of the work on the bottom of the screen. It’s not likely that you will have a memorable and long-lasting experience.


What much of the video use in teacher education is intending to replace is the bothersome and expensive problem of actually being in the classroom. It is an acknowledged problem that full time faculty don’t generally supervise student teachers, and that the work is more often than not relegated to adjuncts and in large universities, to doctoral students. Principals are also hard pressed to find enough time to evaluate all the teachers in their schools, and rely on help from assistant principals and instructional coaches. Now that companies like EdThena are developing software to make it easy and intuitive to provide feedback on teachers’ videos, we are likely to see more and more remote evaluation. No one will remember anymore the value of being in the room, because teaching won’t be seen as relational work, but as a series of techniques to be micro-managed by data analysis and video software.

How is this creeping up on us? In preservice education, we are seeing how Pearson’s scoring of edTPA portfolios is micromanaged by very specific rubrics looking for particular instructional moves in video clips totaling approximately 15 minutes. This leads to some very problematic oversimplification as in this Powerpoint slide widely used to explain the rubric progression of edTPA scoring from one to five:


Why, for example, is a preservice teacher rewarded for a focus on individuals or flexible groups rather than on the whole class? This is a false dichotomy. There are plenty of classroom moments that call for the teacher to focus on the whole class. The danger of delineating “best practices” in this sense is then certain approaches and teaching moves become de-facto no-nos. The truth is there are times when it is appropriate to be letting students explore and do inquiry, and others when students require explicit step-by-step instructions from the teacher. In the new teacher education accreditation standards from CAEP we see that clinical supervision is using “technology-based applications” and “technology-enhanced learning opportunities” that are likely stand-ins for video analysis of teaching. The call for external evaluators in schools as in Governor Cuomo’s budget will likely be done by video (see p. 18 here that says observations may be live or recorded video) and will claim to have teacher and union support. For example, Public Agenda’s initiative Everyone at the Table (with funding from the Gates Foundation) seeks to involve teachers in evaluation reform. Teachers will be persuaded to buy-in to the idea of external evaluation by video because there is some truth to the problem that principals and peers are biased and can have favorites, and video evaluation is seen as more objective. But precisely because it offers less context, and comes with more narrow parameters (that checklist rears its ugly head again), it is more problematic.  


 Although a recent piece by NPR on professions that are likely to be automated in the coming decades  said college professors only had a 3.2% chance of that happening, there is an increasing possibility that a bleak future for unemployed former teacher educators will entail scraping together a measly income from scoring edTPA portfolios, doing supervision and teacher evaluation by video analysis, and putting together data analysis reports from software made by EdThena or other similar companies.


Wednesday, April 1, 2015

Cause for hope. That's right, hope!

A decade ago, Marilyn Cochran-Smith, then president of AERA, gave us a portrait of teacher education at a major crossroads – for better or for worse – and invited us to see where these divergent paths might lead us. At the time, in that hotel ballroom, her bleak portrayal of a future hostile to the ideals and values so many of us held, brought me to tears as I thought of my graduate students who were making so many sacrifices and working so hard to become exemplary urban educators in schools others had written off as “failing” or “ghetto” and doomed.
Why then today, when the draconian education reform ideas of Governor Cuomo have succeeded in a budget vote last night in Albany, do I feel there is cause for hope? Because last night I attended a lecture at Teachers College by the brilliant scholar and public intellectual David C. Berliner. Known especially for his exhaustive defense of public education, The Manufactured Crisis, a 1995 book co-authored with Bruce J. Biddle, Berliner is a master of reasoned argument and robust evidence, all presented with clarity and that wow factor that makes you wonder how anyone could possibly disagree with him. His latest book, 50 Myths & Lies that Threaten America's Public Schools: The Real Crisis in Education, written with Gene Glass, is a must read. He began by characterizing current efforts to evaluate teachers and teacher education using standardized test scores of students as “ridiculous” and proceeded to enumerate a dozen slam dunk arguments against these misguided reforms. I was reminded of the spell Harry Potter learned from Professor Lupin to cast on a boggart, Riddikulus, transforming the scary into the humorous. Below is a photo of the final slide summarizing his reasons.
Berliner, D. C. (2015) "Evaluating Teachers and Teacher Education Using Student Test Data: A Misunderstanding"
            The Teachers College Sachs Lecture Series has set out to explore teacher education – its future, worth, and change (both reactive and transformative) – by examining curriculum, current practices, beliefs about knowledge, and needed research. Prior to Berliner, Marilyn Cochran Smith spoke of education reform, a “hot and huge topic” she defined as “a set of practices and policies, many of which were set into motion with NCLB, although with deeper roots, and continued or accelerated by RTTT. These were intended to fix America’s broken education system keeping with a neoliberal, market-based approach and a heavy focus on accountability.” She described the current state of teacher education as at best, uneven, and at worst, uninspired, ineffective, and out of touch.
            Many of the pessimistic ideas outlined in her AERA address ten years ago are now in motion. We are getting closer to a national database to track teacher education programs and their impact on student test scores, rewarding those effective in test results and enabling them to become, in her words, “lucrative national franchises.” Just look at the expansion of Relay. Politicians and policymakers continue to believe that creating competition and ranking programs, rewarding winners and sanctioning or closing down losers, is going to lead to improvement.
            What concerns me is that current ideas about teacher quality are terribly ill-defined, in large part because much of the research is based on statistics of standardized test results, which are horrible proxies for anything meaningful, and as Berliner pointed out, they measure next to nothing about teacher effects. Right now we are stuck, trapped in the bad idea that all that matters is successful teaching defined as making test scores go up. We have lost all regard for whether good teaching matters, whether the ends to means are ethical and justifiable. Driven by data Data DATA, it seems there is no trust in human judgment, or testimonials of stakeholders who can speak passionately to the difference teachers have made in their lives. They only want numbers.
            Take for example the latest incarnation of the bad ideas in teacher education reform, the Deans for Impact. Based in Austin, Texas with a million dollar start up grant, a group of deans from various colleges of education across the country have resolved to be “data driven, outcomes focused, transparent and accountable” and to use “empirically tested” features in their programs that improve student learning. On their website they boast, “We want to inject some of the values of start-up culture into higher education.” Their first order of business was to write a support statement in early March for the new accreditation organization, CAEP, stating “Deans for Impact stands ready to bring all hands on deck to help CAEP succeed.” Mercedes Schneider has already done the necessary investigation to connect the reform dots and money behind this venture. 
As Jorge Cabrera wrote recently, we are witnessing “a form a social engineering under the guise of ‘urgency’ and ‘reform’” and it comes as no surprise that these deans want to speed up the phase-in of new federal regulations by two years. A rush to implementation will create exactly the sort of chaos and havoc that allows them to ramp up the rhetoric of failure. Their litany of complaints is all too familiar: “teacher prep” is awful, there’s too much theory and not enough practice, it’s too easy to become a teacher. Backed by the simplistic critique of Arthur Levine, these ideas have paved the way for erroneous experiments of throwing beginners to the wolves with little more than a few weeks of boot camp preparation.  
            But the hopeful side has some promise and I believe that we have reached a tipping point. The misuse of value-added measures, or VAMs, in evaluating teachers and teacher education programs is poised for some harsh pushback. The AERA publication, Educational Researcher, has dedicated its latest issue to the VAM controversy. In a succinct and lucid editorial by my former professor at the University of Michigan, Stephen Raudenbush, he deplores the distorted use of VAMs. He cautions, “The hard question is how to integrate the new research on teachers with other important strands of research in order to inform rather than distort practical judgment.” He goes on to pose the question, “Does the answer to a precisely focused research question, by itself, have implications for practical action?” Aside from consistent and reliable evidence, he argues the need for a powerful theory of action to synthesize all of the evidence.

            Get ready for some intense work ahead of us. They will continue to put lipstick on the pig with slick ads, propaganda and celebrity endorsements, and splashy rallies, but money and political power can only go so far. Parents, teachers, professors, and students of all ages must work together on their common educational goals to restore sanity for the good of our universities, schools, and communities.