The problem with NBC's Education Nation - where are the voices of parents and teachers?

cross-posted from Daily Kos

Beginning Sunday, Sept. 26, NBC will be broadcasting a national "Summit" on education, which it has titled Education Nation. There will be panel discussions, an exhibit hall, and it will begin with an electronic town hall with Brian Williams, broadcast live at 12 Noon EDT (so much for people on the West Coast who might be attending religious services). NBC hopes to have several hundred thousand teachers signed up for that town hall.

In theory, one might think what NBC is doing is good - it is a focus on education as a national priority. In practice there are some serious concerns which have already been expressed publicly as well as in numerous communications to people responsible for organizing the event.

Perhaps the most significant concern is this - there are many voices being included, but the voices of parents and teachers are surprisingly not considered a significant part of setting the agenda.

Please keep reading for more details.

On September 13, NBC issued a press release in which it announced the confirmed speakers to date. Here is that list as presented:

• Maria Bartiromo: Anchor of CNBC's "Closing Bell with Maria Bartiromo" and Anchor and Managing Editor of "Wall Street Journal Report with Maria Bartiromo"
• Michael Bloomberg: Mayor, City of New York
• Cory Booker: Mayor, City of Newark, New Jersey
• Phil Bredesen: Governor, State of Tennessee
• Steven Brill: co-founder of Journalism Online, CourtTV and American Lawyer magazine and author of “The Rubber Room” In The New Yorke
• Tom Brokaw: NBC News Special Correspondent
• Geoffrey Canada: CEO & President of Harlem Children's Zone Project
• David Coleman: Founder & CEO, Student Achievement Partners; Contributing Author of the Common Core Standards
• Ann Curry: News Anchor, "Today" and Anchor, "Dateline NBC"
• Arne Duncan: US Secretary of Education
• Byron Garrett: CEO of the National Parent Teacher Association (PTA)
• Allan Golston, President, US Program, The Gates Foundation
• Jennifer M. Granholm: Governor, State of Michigan
• David Gregory: Moderator, "Meet the Press"
• Reed Hastings: Founder & CEO of Netflix
• Lester Holt: Anchor, "NBC Nightly News," Weekend Edition and Co-Host, "Today" Weekend Edition
• Walter Isaacson: President & CEO of the Aspen Institute
• Joel Klein: Chancellor of New York City Schools
• Wendy Kopp: CEO and Founder of Teach for America
• John Legend: Musician; Founder of the Show Me Campaign
• Jack Markell: Governor, State of Delawa
• Gregory McGinity: Managing Director of Policy, The Broad Education Foundation
• Andrea Mitchell: NBC News Chief Foreign Affairs Correspondent and Host, "Andrea Mitchell Reports"
• Janet Murguia: President & CEO of the National Council of La Raza (NCLR)
• Michael Nutter: Mayor, City of Philadelphia, Pennsylvania
• Bill Pepicello, Ph.D.: President of University of Phoenix
• Sally Ride: First Female Astronaut; Vice-chair of Change the Equation
• Michelle Rhee: Chancellor, District of Columbia Public School System of Washington,D.C.
• Edward Rust: Chairman & CEO of State Farm Insurance Companies
• Gwen Samuel, CT delegate to Mom Congress
• Barry Schuler: Former CEO of AOL
• Sterling Speirn: CEO, Kellogg Foundation
• Margaret Spellings: Former US Secretary of Education
• Antonio Villaraigosa: Mayor, City of Los Angeles, California
• Randi Weingarten: President of American Federation of Teachers (AFT-CLO)
• Brian Williams: Anchor and Managing Editor "NBC Nightly News"

For many of us, that list was more than a little unbalanced, and illustrates much of what is wrong with discussions of education policy in this nation. There are many corporate executives, there are people from educational policy organizations, there are politicians, there are foundations. There are journalists. Many of these lack any real knowledge about education, or are well known for pushing a particular view of education to the exclusion of any other.

There are more than 30 names. Of these two are from parent organizations, and there is one representative from the smaller of the two national teachers unions.

Where are the voices of parents?

Where are the voices of those actually teaching?

I have been privy to an exchange of emails between some notable people who raised these concerns and those responsible for recruitment and outreach.

I know that there were strong urgings to reach out to teacher leaders. As far as I can tell, most of those whose names were suggested - and emails were provided - were NOT contacted from the side of NBC. I know, because mine was a name on that list.

I would not necessarily expect to be included on such a list. My one recent teaching award is probably not of a great enough significance to justify inviting me, and my feelings are not hurt.

But why is the first name we see the head of a for-profit university, yet we see no current classroom teachers?

Let's take the presence of the University of Phoenix, and several of the other people on that list. Perhaps it can be explained in part by looking at the sponsors of the event. You can find the list on the website, but let me save you the time:

University of Phoenix
Members Project American Express
Bill & Melinda Gates Foundation
The Eli and Edythe Broad Foundation
W.K. Kellog Foundation
Marvell
BlackBerry
Microsoft
Raytheon
Scholastic
American Airlines

The commitment that NBC is making is notable. The corporate and foundation commitment might be commendable. But I cannot resist making some remarks about that list.

About the Members Project, they have funded two education initiatives this year, Donorschoose.org and Jumpstart for Young Children, based on the votes of those who have American Express Cards. They do not have a person among the speakers, which is probably appropriate.

University of Phoenix is a SPONSOR - and for this they get one of the speaking slots?

The foundations of Gates and Broad have been putting a lot of money into education. They have thereby become major players, able to shape many policy initiatives to their perspective. Some of the efforts might be positive, but there has been a tendency for that point of view to crowd any that might be critical of their efforts, which include things such as Teach for America (note the presence of Wendy Kopp among the speakers, and remember that Michelle Rhee is a TFA alumna) and New Leaders for New Schools. Diane Ravitch uses the term "Billionaire Boys Club" to question the influence of such foundations upon American educational policy.

Why is Stephen Brill one of about thirty speakers and no classroom teacher is?

Why do we not have the voice of say the immediate past National Teacher of the Year, Anthony Mullen, or even the current National Teacher of the Year, Sarah Brown Wessling? To be NTOY one is not only an excellent teacher, but expected to serve as spokesperson for the nation's teachers. Surely one, or better both, of these fine teachers could have been included.

For those who are teachers and want to participate in the Town Hall, you can go to this link to learn more and to sign up.

I have not yet done so. I do not know if I will. I am unwilling to serve as passive wallpaper that can be used to claim support for an effort with which I have serious problems.

One can submit a question to be discussed. It is not clear to me how those questions will be screened. I worry that those that might challenge the underlying assumptions of the summit will be excluded.

I looked at the mission statement for Education Nation. It is appropriate to note our high dropout rate. As I have written before, I think the emphasis on international comparisons demonstrates a misunderstanding of what those comparisons represent. I find too great an emphasis on the economic purposes of education and a total lack of the role of education in preparing a person to be a citizen in a democratic republic. Given the importance of civic participation in a functioning democratic system, I immediately wondered why Sandra Day O'Connor was not an included speaker, given how hard she has worked to raise the issue of civic education?

It is nice that there is a president of a teachers union, albeit the smaller one. I know that the NEA president will be participating in one of the 11 announced panels. But teachers are not their unions. Some of us may even be union activists but feel that our unions do not address some of the real issues we believe need to be addressed. Having one union president and so many corporate types does not allow even for the raising of many of the concerns of teachers, which go far beyond issues of teacher pay and evaluation. I have read and heard that the presence of Randi may be to set her up as illustrative of teachers and their unions as obstructionist to real reform.

There are real issues in American education that need to be addressed. We can read about them in the mission statement. We can see that they are supposedly addressed in the panels.

Supposedly. But too many points of view are not included.

Why is there no representation from people who do Montessori work, which has been proven to be very effective?

Some of the organizations and individuals present have supported the work of the National Board for Professional Teaching Standards. Why is there no representation from that organization. For example, why not invite Jolynn Tarwater, the current National Board Certified Teacher in Residence?

The National PTA organization should be included. It is good that Mom Congress has a representative. That is 2 there representing parents. Against that consider there are four mayors and three governors; and top executives of Netflix, the Aspen Institute, and State Farm Insurance, and the former CEO of AOL. Pray tell, why are these voices more important than those of parents?

Or perhaps we can look at those selected to represent the administrators of schools. We see Joel Klein and Michelle Rhee. They represent ONE viewpoint of how schools should be organized and run. And by the way, the data does not support that either has been all that successful, and in the case of Rhee her approach was just fairly strongly rejected in the primary defeat of her boss Mayor Adrian Fenty of Washington. There have been superintendents with notable success who take a far different approach to educational reform. Where for example is the likes of Carl Cohn, who had notable success in Long Beach, CA?

I cannot tell people how to approach this effort by NBC. I only know that I am skeptical. I may watch the town hall with teachers, but as of now I do not plan to sign up. I am unwilling to provide that kind of validation for something I viewed as at a minimum flawed, and at worst destructive of really addressing the needs of our schools and teachers.

I'd like you to imagine the following. Suppose we are going to have a national summit on health care. Do you not suppose that a substantial number of the voices included would be from professionals in health care, including doctors and nurses? Would you have 3 people with just the head of the AMA to represent doctors?

Or how about legal reform - would not lawyers scream if such a conference were organized without a substantial portion of the main participants being members of the profession representing the range of opinions within the legal field?

Why then is it when it comes to education that people think it is appropriate to have major discussions about education without fair inclusion of the voices of those who bear the greatest burden for the education of our children, the parents and the teachers?

I hope that despite the flaws I see in the organization of this effort some good comes out of it. I fear that it is yet another example of driving educational policy while excluding voices that should be a major part of the discussion. Perhaps the town hall will at least provide some audience for the concerns of teachers, if the questions addressed represent the full range of views and concerns.

I hope I am wrong.

I fear that I may not be.

I worry that this event will yet again mean that teachers - and parents - are excluded from meaningful participation in the shaping of educational policy.

Starting next week, we will see.

And there is time for NBC to work to provide greater balance than what we have so far seen.

Peace.

READ MORE

What Would Happen if Schools Dealt with All the Non Pedagogical Issues?

Most of you have probably seen the (not so) new information on how exercise helps kids learn. What would happen if you took some low-income schools, and without doing anything about pedagogy, did the following:

-increased the amount of PE
-reduced class size to 16
-gave vitamins
-provided nutritious food
-fed them breakfast
-fixed their vision
-fixed their teeth
-provided high quality mental health care (not just medication)
-gave them food to take home if they were worried about eating

and compared these with similar schools where you didn't do anything?

How much of the "achievement gap" would this deal with?

I'm willing to bet these changes would fundamentally change what happened in the schools receiving services and resources. (Whether it would change "achievement measured by tests. . . I'm not sure I really care). I'm also willing to bet that if you compared these schools with schools where you did none of this but worked intensively on pedagogy, you would find that the schools with these targeted services and resources would do significantly better and that the improvements would be much easier to maintain.

But, of course, we're in education. We do pedagogy.

Of course, focusing on pedagogy puts on the blame on those who teach pedagogy and on teachers.

(Note, I haven't gotten to reading the material on the Harlem project, but they also work on pedagogy.)

READ MORE

23 Things they don’t tell you about Capitalism

The table of contents from a book coming out in the US in January (available now in the UK). I haven't read it, but I thought this was a pretty interesting conversation starter by itself, perhaps useful for courses. Via real-world economics blog

23 Things they don’t tell you about Capitalism

Thing One. There is really no such thing as a free market.

Thing Two. Companies should not be run in the interest of their owners.

Thing Three. Most people in rich countries get paid more than they should.

Thing Four. The washing machine has changed the world more than the internet.

Thing Five. Assume the worst about people, and you get the worst.

Thing Six. Greater macroeconomic stability has not made the world economy more stable.

Thing Seven. Free-market policies rarely make poor countries richer.

Thing Eight. Capital has a nationality.

Thing Nine. We do not live in a post-industrial age.

Thing Ten. The US does not have the highest living standard in the world.

Thing Eleven. Africa is not destined for under-development.

Thing Twelve. Government can pick winners.

Thing Thirteen. Making rich people richer doesn’t make the rest of us richer.

Thing Fourteen. US managers are over-priced.

Thing Fifteen. People in poor countries are more entrepreneurial than people in rich countries.

Thing Sixteen. We are not smart enough to leave things to the market.

Thing Seventeen. More education in itself is not going to make a country richer.

Thing Eighteen. What is good for the General Motors is not necessarily good for the United States.

Thing Nineteen. Despite the fall of Communism, we are still living in planned economies.

Thing Twenty. Equality of opportunities is unequal.

Thing Twenty-one. Big government makes people more, not less, open to changes.

Thing Twenty-two. Financial markets need to become less, not more, efficient.

Thing Twenty-three. Good economic policy does not require good economists.

READ MORE

Cross-Cultural Research on Human Development

Entire issue on cross cultural human development. Behind pay wall, I'm afraid, but you can see the abstracts. Haven't read it but a summary of some of the material is on Neuroanthropology. Haven't read it yet, but it looks fascinating.

READ MORE

Problems with the use of Student Test Scores to Evaluate Teachers

originally posted at Daily Kos

If new laws or policies specifically require that teachers be fired if their students’ test scores do not rise by a certain amount, then more teachers might well be terminated than is now the case. But there is not strong evidence to indicate either that the departing teachers would actually be the weakest teachers, or that the departing teachers would be replaced by more effective ones. There is also little or no evidence for the claim that teachers will be more motivated to improve student learning if teachers are evaluated or monetarily rewarded for student test score gains.

That is a quote from the Executive Summary of one of the most important policy briefs about education in recent years. At a time when the Dept. of Education is pushing to tie teacher evaluation and compensation to student test scores, this Economic Policy Institute Briefing Paper (whose title is the same as this diary, and which is a pdf), pulls together the extensive relevant research that demonstrates the dangers of pursuing such a path. Please continue reading as I explore this important document, released at 12:01 AM today, August 29.

First, let me clarify several things.

This is a very long diary. That is because I am trying to reasonably thoroughly cover the contents of an extremely important document. My purpose in doing so is to convince people of the document's importance. Thus I will be perfectly happy should you decide you do not need to further read what I have written below. You can follow the link for the brief (which I have provided you again), download the pdf, and begin reading. The executive summary is only four pages. The brief itself, without the critical apparatus of footnotes and sources, another 17. So if you want, one more time follow this link.


This document has been in the works for several months, and was NOT hurriedly put together as a response to the recent series by the Los Angeles Times which used value-added assessment to label teachers in the Los Angeles Unified School District. Second, the ten scholars whose names are on the document are some of the most eminent in educational circles, including among their midst former Presidents of the American Educational Research Association and the National Council on Measurement in Education, two of the three professional organizations most involved with psychological measurement, of which school-related testing is a subset. One of the scholars, Robert Linn, has not only presided over both of those organizations, he has also serve as chair of the National Research Council's Board on Testing and Assessment. The group also includes the immediate past president of the National Academy of Education, Lorrie Shepard, Dean of the School of Education at Colorado. A brief and applicable curricula vitae of each of the ten authors can be found at the end of the document, and briefer descriptions at the beginning, where each author is listed, along with the following statement:

Authors, each of whom is responsible for this brief as a whole, are listed alphabetically.

An email address is provided for further contact.

The ten authors, alphabetically, are as follows:
Eva L. Baker
Paul E. Barton
Linda Darling-Hammond
Edward Haertel
Helen F. Ladd
Robert E. Linn
Diane Ravitch
Richard Rothstein
Richard J. Shavelson
Lorrie A. Shepard

Let me be blunt. I do not know how anyone who knows the work of these scholars and who reads this brief can accept the idea of placing any stakes as to firing or awarding of merit pay based on the current status of Value-Added Assessment methodologies. The document is thorough. It reviews all the relevant studies, including one not yet in print. Those includes studies by Mathematica for the US Department of Education: by Rand: by the Educational Testing Service; done for the National Center for Education Statistics of the Institute of Education Sciences of the U. S. Dept. of Education; issued by the Board of Testing and Assessment of the Division of Behavioral and Social Sciences and Education of the National Academy of Sciences, and so on. There are citations from books, from peer reviewed journals.

I am not a scholar. I am a high school social studies teacher. During now abandoned doctoral studies in educational policy I got interested in value-added assessment and devoured what studies there were in the educational literature. I also talked extensively with the technical person for one organization that offered a value-added methodology who cautioned me that the approach was not stable enough for it to be used as the basis for decisions with any kind of meaningful stakes. That was about a decade ago. What I had read since, and what I have absorbed from this study convinces me that the situation is not significantly better now.

But you do not have to take my word for it. Let me offer a few key examples from the study. Those who follow me on Daily Kos already have seen in the study by Mathematica the high rate of error in determining superior and inferior teachers beyond the broad middle. In this diary, written on August 27, I noted that the error rate with 2 years of data was 36%, with 3 years 26%, and even with 10 years of data still 12%.

But that is just the tip of the iceberg of the technical problems with using such an approach.

Without recapitulating the entire brief, let me offer a couple of other key points.

1. Results for individual teachers are not stable:

One study found that across five large urban districts, among teachers who were ranked in the top 20% of effectiveness in the first year, fewer than a third were in that top group the next year, and another third moved all the way down to the bottom 40%. Another found that teachers’ effectiveness ratings in one year could only predict from 4% to 16% of the variation in such ratings in the following year.

2. One key question is whether one is really accounting for teacher effects and excluding other influences in the results one gets from value-added assessment. Jesse Rothstein reported something interesting, about which I quote from the Executive Summary:

A study designed to test this question used VAM methods to assign effects to teachers after controlling for other factors, but applied the model backwards to see if credible results were obtained. Surprisingly, it found that students’ fifth grade teachers were good predictors of their fourth grade test scores. Inasmuch as a student’s later fifth grade teacher cannot possibly have influenced that student’s fourth grade performance, this curious result can only mean that VAM results are based on factors other than teachers’ actual effectiveness.

3. The brief notes that arguments that the private sector evaluates professional employees using quantitative measures that are parallel. The authors of the brief point out that rarely are such quantitative measures the sole or even the primary factor, noting that management experts warning against using such measures for making salary or bonus decisions. They remind us that some of the distortion on Wall Street was the result of emphasizing short term gains that could be easily measured. They also touch on medicine:

In both the United States and Great Britain, governments have attempted to rank cardiac surgeons by their patients’ survival rates, only to find that they had created incentives for surgeons to turn away the sickest patients.

4. Students are not randomly assigned to teachers. While some control for school effects is possible, scholars are reluctant to place any weight on comparisons for teachers in different schools even within the same system. And even within a school, teachers may have varying numbers of students who are learning English or have learning disabilities or are homeless or who move multiple times, each of which is a factor that can affect learning.

5. Sample sizes are often too small. Even if the class makeup stays stable during the year, and all the students show up regularly, the N=30 of a large elementary class is too small a sample to provide a result that can allow strong inferences to be drawn. Often the makeup of the class changes during the year. If you exclude students who were not there all year, or whose absences exceed some designated level, the N decreases, providing a result of even less reliability.

6. Some argue that statewide data banks can address the question of student mobility. But if you derive results on a year or two years of data where the student has moved, how much of the improvement can properly be assigned to any one teacher? Even in elementary school, do we account for pull-out instruction, or possible tutoring (that could in some cases be counterproductive) as a possible influence on the test results upon which we base our analysis?

7. Even with value-added analysis, to date scholars have not been able to isolate the impact of outside learning experiences, home and school supports, and differences in student characteristics and starting points when trying to measure their growth.

8. A proper system of value-added assessment would have vertically scaled tests. Most states do not currently have such tests, for example, neither New York nor California does. That is, the tests in one grade are not necessarily congruent with those of the next along a continuum from year to year - we are not testing the same thing each year. As testing expert Dan Koretz of Harvard is quoted as noting,

"because of the need for vertically scaled tests, value-added systems may be even more incomplete than some status or cohort-to-cohort systems"

Here it is worth noting that cohort to cohort is comparing this year's fourth graders to last years, which is how Adequate Yearly Progress under No Child Left Behind has been calculated.

9. If measuring end of year to end of year, even if there are vertically scaled tests, there is still the well-documented issue of summer learning loss, which falls disproportionally upon those of lesser economic means, which also means it falls disproportionally upon those of color, who are more heavily represented at the lower end of the economic scale. IF we do not control for summer learning loss, our results are skewed. Allow me to quote a relevant portion of the study:

researchers have found that three-fourths of schools identified as being in the bottom 20% of all schools, based on the scores of students during the school year, would not be so identified if differences in learning outside of school were taken into account. Similar conclusions apply to the bottom 5% of all schools.

The authors also cite a study that shows "two-thirds of the difference between the ninth grade test scores of high and low socioeconomic status students can be traced to summer learning differences over the elementary years."

There is more, but this should give a real sense of how much there is in this paper, how thoroughly the authors examine relevant material to demonstrate that value-added assessment, the supposed magic bullet to allow us to tie student learning back to the effectiveness of teachers, cannot properly fulfill the task some wish to give to it.

The authors acknowledge that value-added approaches are superior to some of the alternatives methods of using test scores to evaluate teachers. These are

status test-score comparisons - compare average scores of students of one teacher to those of another

over change measures - compare the average test results of a single teacher from one year to the next - remember, these are different students

over growth measures - a comparison of the scores of the students of the teacher this year to the scores of those same students the previous year when they had different teachers.

Each of these approaches has serious problems with it. One can read the detailed explanation on p. 9. Value-added assessments may be an improvement, but

the claim that they can “level the playing field” and provide reliable, valid, and fair comparisons of individual teachers is overstated. Even when student demographic characteristics are taken into account, the value-added measures are too unstable (i.e., vary widely) across time, across the classes that teachers teach, and across tests that are used to evaluate instruction, to be used for the high-stakes purposes of evaluating teachers.

Let me offer a few of the quotes about value-added assessment that the authors of the brief offer from scholars who have examined the approach over the years, and then I will offer a few observations of my own.

in 2003, a research team at Rand concluded

The research base is currently insufficient to support the use of VAM for high-stakes decisions about individual teachers or schools.

In 2004, Donald Rubin opined

We do not think that their analyses are estimating causal quantities, except under extreme and unrealistic assumptions.

Henry Braun, then at ETS, offered this in 2005:

VAM results should not serve as the sole or principal basis for making consequential decisions about teachers. There are many pitfalls to making causal attributions of teacher effectiveness on the basis of the kinds of data available from typical school districts. We still lack sufficient understanding of how seriously the different technical problems threaten the validity of such interpretations.

Last year the Board on Testing and Assessment of the National Research Council of the National Academy of Sciences wrote to the Department of Education saying

...VAM estimates of teacher effectiveness should not be used to make operational decisions because such estimates are far too unstable to be considered fair or reliable.

Finally, this year, a report of a workshop run jointly by The National Research Council and the National Academy of Education offered this:

Value-added methods involve complex statistical models applied to test data of varying quality. Accordingly, there are many technical challenges to ascertaining the degree to which the output of these models provides the desired estimates. Despite a substantial amount of research over the last decade and a half, overcoming these challenges has proven to be very difficult, and many questions remain unanswered...

Let me repeat that last sentence, written this year: Despite a substantial amount of research over the last decade and a half, overcoming these challenges has proven to be very difficult, and many questions remain unanswered...

And yet this administration wants to move ahead with using student test scores, perhaps analyzed through value-added assessment methodologies, as a significant component of teacher evaluation. It is including this as part of the criteria to win Race to the Top Funds. In fairness, the Department does not specify using value-added (although anything else is far worse) nor does it specify what percentage of the evaluation is to depend upon the test scores - both of these decisions are still left to the states, some of which have left themselves wiggle room in their applications, using terms like "significant" to indicate the proportion of the evaluation that will depend upon student test scores.

The original Bush proposal for No Child Left Behind, as it went up on the White House website shortly after the inauguration of the 43rd president, proposed giving a 1% bonus of Title I money to schools that would give parents the value-added scores of the teachers of their students. That, fortunately, did not make it into the final legislation. Now we have the Los Angeles Times action, about which the Secretary of Education has offered a somewhat mixed and confusing response, even as he seems to support the idea of using such evaluations in assessing of teachers. Since the Times story broke we have seen some who write or advocate about education who have praised what the paper did, while others have condemned it. While mine might not be a major voice on education, I find myself very much in the latter camp.

One problem is that too many who write about education are close to ignorant about the limits of the information one can get from various kinds of assessment. We tend to what hard numbers as a society, we are obsessed with comparisons and rankings. In the process we often give far more credence to quantitative measures than they warrant.

I do not dispute that tests, including tests external to the school, have some utility. I also recognize that value-added assessment is beginning to offer some useful additional information. By itself that information is not sufficiently reliable that people's livelihoods should be either solely or heavily determined by the information they provide. They MAY indicate a teacher outside the norm - either well above or well below - but as the various studies you will encounter in this brief demonstrate, that is not necessarily the case, the results are not yet stable for individual teachers from year to year, we do not yet know how to properly control for non-instructional factors that can influence the scores upon which the analysis is based, nor can we properly distribute responsibility for student learning among the different adults who interact with a child at school.

I am a high school teacher. Let me offer a hypothetical - if I do more work in a social studies class on a particular kind of writing and that is what is assessed on the English exam, does the English teacher properly deserve the credit or blame for how students do on that part of the test? Those of us who teach in high school are aware that students often learn about our content either in other classes or from interactions outside of our classroom. Sometimes what they learn is correct and increases their performance in our class, sometimes it is incorrect and undercuts what we are instructing. To date, even value-added assessment is insufficient to control for such influences and allow proper inferences to be drawn about the actual impact of the teacher upon the learning of the students.

I have only explored a small portion of the material in the brief. You can download it without paying. If you are worried about whether you will be able to understand the contents, don't. You can start with the executive summary, in which you will find most of the key takeaways, written in language and presented in a style that is easily accessible. It is a bit less than four pages. The brief itself runs from pages 5-21, followed by three columns (over a page and a half) of footnotes, and 5 columns (over three and half pages) of sources. You can read through the brief without having to check the footnotes, or you can if you want glance at the back to see who is being cited if that is not clear in the text.

Let me clear. The authors are not opposed to value-added assessment. They are not even opposed to it being included in the process of teacher evaluation, although they offer some serious cautions that policy makers would be well advised to consider.

The title is accurate - there are still serious problems with using test scores to evaluate teachers. These problems are not solved by resorting to a value-added methodology.

We need to be careful not to denigrate nor discourage our teaching corps. We will not improve education if the end result of our efforts is to drive away the very teachers who most connect with students, who are able to inspire those students to persist when they are struggling, who are willing to take on the harder to teach. We have other methods of ascertaining whether teachers are in fact effective. We should not be abandoning them in favor of quantitative measures that cannot, as yet, fully carry the load.

The authors of this study have enough prestige that one can hope our media will give some attention to it. Those responsible for educational policy at local, state and national levels are not doing their jobs if they are unwilling to read and be sure they understand the implications of this brief.

That said, and adding that I will try to bring to the attention of as many policy makers as I can, I do not have high hopes that our wrongheaded headlong pursuit of quantitative measures of teacher effectiveness can even be slowed. I will add what voice I have to the efforts of these scholars. Perhaps after you read the brief, you will add yours?

Thanks.

READ MORE

Life Without Language

I found this post about the relationship between thought and language fascinating.

Human thought, for the majority, is not simply the individual outcome of our evolved neural architecture, but also the result of our borrowing of the immense symbolic and intellectual resources available in language. What would human thought be like without language? . . .

My own feeling, and I have not worked with a population that has a non-Western sense of time, is that it’s likely a softer form of the Whorfian argument, that language and culture affect the perceptual qualities of different sensory channels to varying degrees (perhaps more in some phenomenal qualities than in others) is the most defensible (and arguably, this is what Whorf was arguing all along). Time, for example, may be difficult to perceive in certain ways if you are not culturally trained to habitually conducting yourself in relation to time appropriately: certainly, there is deep cultural difference in the degree to which people orient themselves by the clock, and varying emphases that societies place on recurrence or irreversibility of time. This isn’t to say that language is a perceptual world, but rather than languages can induce certain perceptual biases that may be more or less difficult to overcome. But what about those without language? . . .

So can people have thought without words? Well, the evidence-based answer would seem to be, yes, but it’s not the same sort of thought. Some things appear to be easier to ‘get’ without language (such as imitation of action), other things appear to be a kind of ‘all-at-once’ intuition (such as suddenly realizing all things have names), and other ideas are difficult without language being deeply enmeshed with cognitive development over long periods of time (like an English-based understanding of time as quantitative and spatialized). In other words, language is not simply an either/or proposition, but part of a cognitive developmental niche that shapes both our abilities and (unperceived) disabilities relative to the fully cognitively matured language-less individual.
--Greg Downey

--

READ MORE

An incredibly important speech on education by Diane Ravitch

That is a brief clip of Diane Ravitch addressing the Representative Assembly of the National Education Association on July 6, where she was receiving an award as the 2010 "Friend of Education."

Please keep reading.

The complete text of Diane's speech can be read here. She has given me permission to quote as much as I deem appropriate, including the whole speech if necessary.

I won't do that. You can follow the link to read the entire text if so inclined.

Let me offer some selections to at least whet your appetite, as well as offer a bit of commentary of my own.

... in all of this time, aside from the right-wing think tanks, I haven’t seen met a single teacher who likes what’s happening? I haven’t met a single teacher who thinks that No Child Left Behind has been a success. I haven’t met a single teacher who thinks that Race to the Top is a good idea.

I remind readers that the Representative Assembly passed a resolution of no confidence in Race to the Top.

And as I talk to teachers, by the end of my talk, I hear the same questions again and again: What can we do? How can we stop the attacks on teachers and on the teaching profession? Why is the media demonizing unions? Why does the media constantly criticize public schools? And why does it lionize charter schools? Why is Arne Duncan campaigning with Newt Gingrich? Why has the Obama Administration built its education agenda on the punitive failed strategies of No Child Left Behind?

Newt Gingrich - now there's a great ally for a supposedly progressive administration, eh? And during the campaign, Obama railed against NCLB, yet too much of the administration policy continues to rely on the failed policies of that approach.

I will continue to speak out against high-stakes testing. It undermines education. High-stakes testing promotes cheating, gaming the system, teaching to bad tests, narrowing the curriculum. High-stakes testing means less time for the arts, less time for history or geography or civics or foreign languages or science.

We see schools across America dropping physical education. We see them dropping music. We see them dropping their arts programs, their science programs, all in pursuit of higher test scores. This is not good education.

I have been told by some people in the Obama Administration that the way to stop the narrowing of the curriculum is to test everything. In fact, the chancellor in Washington, D.C., the other day announced she plans to do exactly that. That means less time for instruction, more time for testing, and a worse education for everyone.

Some of us have worried about this trend for years - I remember a group of elementary school art teachers asking their state for a test on art so their classes would not be eliminated. As it happens, my course is one in which there is a test that has high stakes - students in theory must not only pass a government course but also a state test in government in order to graduate from high school (although the latter requirement has some loopholes). Let me say that for too many students their course in government gets reduced, especially in the Spring as the test approaches, to drill and kill, practice for the test. For a subject that should excite them, because it has direct affect on their lives, they get bored and frustrated.

In speaking out, I have consistently warned about the riskiness of school choice. Its benefits are vastly overstated. It undercuts public education by enabling charter schools to skim the best students in poor communities. As our society pursues these policies, we will develop a bifurcated system, one for the haves, another for the have-nots, and politicians have the nerve to boast about such an outcome.

Public schools, as I said before, are a cornerstone of our democratic society. If we chip away at support for them, we erode communal responsibility for a vital public institution.

Bifurcated - even worse than what we have by geography, where wealthy communities have excellent public schools rich in resources and the students have access to all kinds of elective courses, and poor communities, whether in inner cities, inner rings of suburbs or the hinterlands, lacking equipment, with decaying buildings, and overwhelmed with students arriving st school with less background and current problems.

democratic society - if we really believe in it, economics would not be the sole basis on which we make arguments about our schools.

Last year, a major evaluation showed that one out of every six charters will get better results, five out of six charters will get no different results or worse results than the regular public schools. A report released just a couple of weeks ago by Mathematica Policy Research once again shows charter middle schools do not get better results than regular public middle schools.

Unfortunately, the general media coverage of the Mathematica report was badly flawed, focused on the schools that did 'better' while not including any of the caveats about even these schools. Charters COULD be used to offer alternative ways of teaching/learning to specific groups of students. Diane's next two paragraphs are very important:

The National Assessment of Educational Progress, on whose board I served for seven years, has tested charter schools since 2003. In 2003, 2005, 2007 and 2009, charter schools were compared to regular public schools and have never shown an advantage over regular public schools. Charter schools, contrary to Bill Gates, are not more innovative than regular public schools. The business model and methods of charter schools is this — longer school days, longer hours, longer weeks, and about 95 percent of charter schools are non-union.

Teachers are hired and fired at will. Teachers work 50, 60, 70 hours a week. They are expected to burn out after two or three years when they can be replaced. No pension worries, no high salaries. This is not a template for American education.

NAEP is the national report card on education. It is considered the gold standard of educational evaluation. It does not show that charters do better. One reason why some "reformers" like charters is that in many states they are a way around unions, and their teachers can be fired at will.


Let me skip down a bit:

And perhaps we should begin demanding that school districts be held accountable for providing the resources that schools need. Just like No Child Left Behind, Race to the Top requires and pressures districts to close low-performing schools. The overwhelming majority of low-performing schools enroll students in poverty and students who don’t speak English and students who are homeless and transient. Very often, these schools have heroic staffs who are working with society’s neediest children. These teachers deserve praise, not pink slips. Closing schools weakens communities. It’s not a good idea to weaken communities. No school was ever improved by closing it.

Reread that please. Yes, you will read stories that supposedly focus on "high-performing" schools dealing with such students. In some cases the claims for high performance are based on selective use of data. In most cases the schools on which such focus is made get more resources (as do many charters), have longer days, etc. The "success" is claimed on the basis of test scores. What is not yet offered is any evidence that there are long-term gains in learning: that the students are developing skills and knowledge that they can apply outside of the test environment. Meanwhile we reconstitute schools. We use one of the four models approved by this administration, even though NONE has any research to demonstrate that they improve education.

There are passages about the right to unionize, which Diane supports, but which "reformers" oppose. Read this paragraph, and perhaps you will understand two things, (1) why teachers are reacting so positively towards Diane; and (2) why we feel unfairly besieged, that the playing field is tilted:

I have spoken out repeatedly to defend the right of teachers to join unions for their protection and the protection of the teaching profession. Teachers have a right to a collective voice in the political process. It’s the American way. I don’t see the Wall Street Journal or the Washington Post or the pundits complaining about the charter school lobby. I don’t see them complaining about the investment bankers lobby, or any other group that speaks on behalf of its members. Only teachers’ unions are demonized these days.

Teachers, and those who support them, ARE being demonized. By constrast, Hedge Fund managers (who are making major investments in things like charter schools for tax benefits) and Wall Street Firms (who came close to destroying the economy of this nation and the international community) get bailed out with our tax dollars, continue to pay bonuses, and spend millions to prevent appropriate oversight and regulation. Then they want to have a voice telling us how we should teach, how our schools should be run.

There is so much of value in the speech. By now I hope I have at least convinced you to take the time to read the entire thing.

Let me offer only a few more snippets, skipping over some very important material:

Around the world, those nations that are successful recognize that the best way to improve school is to improve the education profession. We need expert teachers, not a steady influx of novices.

One argument against Teach for America, for example. Now if those in that program actually stayed in teaching, people like Ravitch and me would have far fewer objections. The constant turnover in the schools in which they serve is unfair to those kids. The program benefits many in the TFA corps, and it certainly benefits TFA. It is not clear that the students are getting all that much benefit, and the model is not something that can really address the needs of the millions of students in inner city and rural schools.

The current so-called reform movement is pushing bad ideas. No high-performing nation in the world is privatizing its schools, closing its schools, and inflicting high-stakes testing on every subject on its children. The current reform movement wants to end tenure and seniority, to weaken the teaching profession, to silence teachers’ unions, to privatize large sectors of public education. Don’t let it happen.

The consequences of letting these "reforms" go forward unchallenged will be great damages far beyond the arena of public education. It will be further destruction of what is left of the union movement in this country. It will be increased privatization of what is left of the commons in this country/ It will be a narrowing of opportunity for too many of our young people. It will diminish us as a people as our young people receive narrower and narrower educations.

Diane urges those listening to her to be politically active, to remind people that there are millions of teachers, we vote, and so do our families, to not support anyone who is an opponent of public education.

Stand up to the attacks on public education. Don’t give them half a loaf, because they will be back the next day for another slice, and the day after that for another slice.

Don’t compromise. Stand up for teachers. Stand up public education, and say “No mas, no mas." Thank you.

Diane Ravitch received a rousing ovation for this speech. As a teacher, as a UNIONIZED teacher in a public school, I understand why.

I thought it important that as many people as possible encounter HER words, not just cursory news accounts. I think it important that voices that speak for teachers and for public schools be given as much of an audience as those who have described themselves as 'reformers' and seek to suppress or denigrate any opposing point of view.

That is why I asked Diane, a friend, if I could quote extensively. That is why Diane told me "You are free to cite or quote whatever you wish."

Thanks for reading.

Please pass on the link for her speech.

Peace.

READ MORE