Tag Archives: Teacher Evaluation

New Jersey may eliminate teacher tenure

16 Jan

People become teachers for many reasons. Among the top ten reasons to become a teacher are: 

1. Student Potential

2. Student Successes

3. Teaching a Subject Helps You Learn a Subject

4. Daily Humor

5. Affecting the Future

6. Staying Younger

7. Autonomy in the Classroom

8. Conducive to Family Life

9. Job Security

10. Summers Off 

Because of the recession, many are turning to teaching as a career that might have employment possibilities. Although there may be job cuts as states and some locales cope with diminishing tax revenue, the education sector still looks good in comparison with other sectors. Information about teaching requirements can be found at Education Week Career Community

The issue of teacher tenure is important because: 

There is no shortage of data that show a significant percentage of teachers leave just when they are becoming consistently effective. However, at the same time, too many teachers who have not become consistently effective achieve permanent status, also referred to as tenure. 

The question surrounding teacher tenure is how to protect quality teachers from unfair termination?

What is Teacher Tenure?

A good basic description of teacher tenure as found at teacher tenure. James gives the following definition:

WHAT IS TENURE?

Tenure is a form of job security for teachers who have successfully completed a probationary period. Its primary purpose is to protect competent teachers from arbitrary nonrenewal of contract for reasons unrelated to the educational process — personal beliefs, personality conflicts with administrators or school board members, and the like.

WHAT PROTECTION DOES TENURE OFFER THE PUBLIC SCHOOL TEACHER?

The type and amount of protection vary from state to state and — depending on agreements with teachers’ unions — may even vary from school district to school district. In general, a tenured teacher is entitled to due process when he or she is threatened with dismissal or nonrenewal of contract for cause: that is, for failure to maintain some clearly defined standard that serves an educational purpose.  

Time has a good summary of the history of teacher tenure at A Brief History of Tenure

Education News is reporting in the article, Christie’s Reforms May End Teacher Tenure in New Jersey:

Under Governor Chris Christie’s proposed education reforms, New Jersey may soon see the end of teacher tenure. Administrative and legislative officials confirm that much of Christie’s reforms could become law in the first half of 2012, writes Jason Method at the Statehouse Bureau.

Christie is also looking for more charter schools or private-public schools in urban areas.

State Sen. M. Teresa Ruiz, head of the Senate Education Committee, believes there is growing momentum for an assortment of reform measures as many school districts could see an end to annual budget votes.

“It doesn’t matter where you’re coming from, as a union rep, from the principal’s association or a teacher, we’re all talking about what needs to get done to ensure we have great student outcomes,” Ruiz said.Christie declared 2011 as the Year of Education Reform. The governor said the kinds of reforms he wants have been heralded by President Obama and U.S. Education secretary Arne Duncan.

http://www.educationnews.org/education-policy-and-politics/christie%e2%80%99s-reforms-may-end-teacher-tenure-in-new-jersey/

What are the Pros and Cons of Teacher Tenure?

One of the best concise defenses of K-12 teacher tenure is from Cleolaf’s blog at Why K12 Teachers Need Tenure The reasons are: 

A) The teacher shortage is not evenly distributed. High performing schools don’t have the same problems attracting teacher. High paying district don’t have the same problems attracting teachers….

B) This really comes down to the question of why principals might want to be rid of a teacher. I would suggest that any manager would want to be rid of any employee who makes his/her job or life harder. Ideally, this would only be low performing teachers, but that is a fantasy view.

Any kind of rabble rouser can make a principal’s job harder. …Obviously, union activists are already protected by other labor laws.

C) Academic freedom in K12 is not like in higher education, that’s true. But it is still an issue.

A teacher who tries to raise the bar in his/her classes can create no end of problems for a principal. If standards in school have been too low, and a teacher demands more than students are accustomed to, students and their parents can demand enormous amounts of principal’s time. This is a different form of rocking the boat, but can still be enough for a principal to wish to be rid of the teacher.

Principals cannot be experts on everything. Once, when teaching high school English, my principal as a former middle school math teacher. He insisted that I as an English teacher, “not worry about critical and analytical thinking” and “just teach English.” Though he had no training or experience with high school English, he had ideas about what it meant. He did not approve of the fact that I was spending as much time on teaching my student how to reason as on the mechanics of writing. …

Another principal might be an old school traditionalist and insist that English classes only be about books. He might not approve of using film or video to teach about theme, plot, symbolism, character development, story arcs, allegory and any of the rest. But a teacher might feel that this would be the best way for students to learn these lessons….

No, we don’t need tenure if principals can be counted on to make good decisions in the best interests of children. But they are human, and therefore often make decisions in their own interests. Moreover, we have a real shortage of high quality principals, even as we are breaking up large schools into multiple small schools and opening up charter schools…. 

I do not suggest that there are not problems with our tenure system. A lot falls to principals, perhaps too much. Teacher observation and evaluation is not easy, and the tenure process in dependent on principals making good decisions about teachers during those first three years. …And that is why we still need tenure. It takes a series of bad decisions over a number of years for a poor teacher to get tenure. But without tenure, it only takes one bad decision for a good to be dismissed.  

Cleolaf points toward insufficient teacher assessment and evaluation as a prime cause of problems with teacher tenure. Research confirms that good principals are key to high performing schools. Good principals are also the key in Cleolaf’s view to making a tenure system work.

Another view of teacher tenure is found at Teacher Tenure: A Life Sentence for Kids This paper begins with the following case:

In 1986, after school administrators in the El Cajon School District in California

spent years documenting the more than 400 reasons for why high school English teacher

Juliet Ellory was an unfit teacher, the district finally succeeded in firing her. It cost the

district more than $300,000 and eight years of preparing and litigating the case.

According to the overwhelming evidence against her, Ms. Ellory “hardly ever lectured,

gave baffling assignments, belittled students and ignored repeated efforts by the high

school principal to get her to improve.”1 Ellory’s tenure status had protected her from

automatic dismissal. Though stories such as this one do not depict the average K-12

teacher, they are sufficiently widespread to provoke criticism and concern about the state

of our public schools, as well as skepticism regarding the actual benefits of teacher

tenure.

A key component of reforming teacher tenure is an improved evaluation system for teachers, which focuses on improving traits that produce student achievement.

Teacher Evaluation

The Center has produced a report, which focuses on teacher evaluation. Teacher Evaluation  Proper evaluation seems to be key to both addressing many problems teacher tenure was developed to protect from faulty evaluation of a teacher and to improve the quality of those in the teaching profession. Evaluation is just one component, however. New teachers need a proper induction into the profession and mentors to help them hone their skills and methods of teaching. If problems emerge, teachers need proper training and coaching to progress.

No matter where a teacher is in their career lifecycle, they will be confronting the issues of elimination of teacher tenure and more rigorous teacher evaluation. Increasingly, one component of teacher evaluation will focus on whether students are showing academic achievement gains. The point of contention, which may provoke disagreement between the evaluator and the teacher is how student achievement is measured.

In times of recession, all jobs become more difficult to find and often job seekers do not have the luxury of finding the perfect job. New teachers may find jobs in schools often considered less desirable or schools led by principals who are not considered to be leaders or supporters of their staff. Not all learning occurs during the academic portion of your life’s journey. If one finds that the first job is not the perfect opportunity, then prepare for the time you will find the perfect opportunity. Look for a teacher(s) you admire and who are successful and model what has made them successful. People who are skilled and become expert at their craft or profession will weather whatever change comes along, whether it is an elimination or modification of tenure and changes to the way evaluations are conducted.

Dr. Wilda says this about that ©

Tags: , , , , ,

New Harvard study about impact of teachers

8 Jan

The Guide to Teacher Quality lists several key attributes of a quality teacher:

WHAT WE KNOW ABOUT TEACHER QUALITY

• Experience is very important. The ability of a new teacher to support student learning

increases greatly during his/her first year of teaching and continues to grow through at least the

first several years of teaching (Clotfelter, Ladd & Vigdor, 2007; Clotfelter, Ladd & Vigdor, 2004;

Hanushek et al., 1998).

• Teacher attrition matters. Districts and schools with relatively high rates of teacher

attrition are likely to have more inexperienced teachers and, as a result, instructional quality

and student learning suffer (Alliance for Quality Teaching, 2008).

• Ability matters. Teachers with higher scores on college admission or licensure tests as well

as those from colleges with more selective admission practices are better able to support student

learning (Gitomer, 2007; Rice, 2003; Wayne and Youngs, 2003; Reichardt, 2001; Ferguson

& Ladd, 1996; Greenwald, Hedges & Laine, 1996).

• Teachers’ subject matter knowledge helps students learn. Students learn when their

teacher knows the subject, particularly in secondary science and mathematics (Floden &

Meniketti, 2006; Rice, 2003; Wayne and Youngs, 2003; Reichardt, 2001).

• Preparation and training in how to teach makes a difference. Knowing how to teach

improves student learning, particularly when a teacher is in his/her first years of teaching (Rice,

2003; Allen, 2003; Boyd, Grossman, Lankford, Loeb & Wyckoff, 2005).

• Teacher diversity may also be important. There is emerging evidence that students learn

better from teachers of similar racial and ethnic background (Dee, 2004; Dee, 2001; Hanushek

et al. 1998).

One of the important attributes is the subject matter knowledge of the teacher. These findings are particularly important in light of the study, The Long-Term Impacts of Teachers: TeacherValue-Added and Student Outcomes in Adulthood by Raj Chetty, Harvard University and NBER , John N. Friedman, Harvard University and NBER, and Jonah E. Rockoff, Columbia University and NBER .

Here is a portion of the executive summary:

Many policy makers advocate increasing the quality of teaching, but there is considerable debate about the best way to measure and improve teacher quality. One method is to evaluate teachers based on their impacts on students’ test scores, commonly termed the “value-added” (VA) approach. A teacher’s value-added is defined as the average test-score gain for his or her students, adjusted for differences across classrooms in student characteristics such as prior scores. School districts from Washington D.C. to Los Angeles have begun to use VA to evaluate teachers. Proponents argue that using VA can improve student achievement (e.g. Hanushek 2009), while critics argue that test score gains are poor proxies for a teacher’s true quality (e.g. Baker et al. 2010).

The debate about VA stems from two fundamental questions. First, does VA accurately measure teachers’ impacts on scores or does it unfairly penalize teachers who may systematically be assigned lower achieving students? Second, do high VA teachers improve their students’ long-term outcomes or are they simply better at teaching to the test? Researchers have not reached a consensus about the accuracy and long-term impacts of VA because of data and methodological limitations.

We address these two questions by tracking one million children from a large urban school district from 4th grade to adulthood. We evaluate the accuracy of standard VA measures using several methods, including natural experiments that arise from changes in teaching staff. We find that when a high VA teacher joins a school, test scores rise immediately in the grade taught by that teacher; when a high VA teacher leaves, test scores fall. Test scores change only in the subject taught by that teacher, and the size of the change in scores matches what we predict based on the teacher’s VA. These results establish that VA accurately captures teachers’ impacts on students’ academic achievement and thereby reconcile the conflicting conclusions of Kane and Staiger (2008) and Rothstein (2010). These methods provide a simple yet powerful method to estimate the bias of value-added models in any district; interested readers can download computer code to implement these tests from this link.

In the second part of our study, we analyze whether high VA teachers also improve students’ long-term outcomes. We find that students assigned to higher VA teachers are more successful in many dimensions. They are more likely to attend college, earn higher salaries, live in better neighborhoods, and save more for retirement. They are also less likely to have children as teenagers.

Teachers’ impacts on students are substantial. Replacing a teacher whose true VA is in the bottom 5% with a teacher of average quality would generate lifetime earnings gains worth more than $250,000 for the average classroom. VA estimates are less reliable when they are based on data from a small number of classes. However, even after observing teachers’ impacts on test scores for one year, estimates of VA are reliable enough that such personnel changes would yield large gains on average.

Teachers have large impacts in all the grades we analyze (4 to 8), implying that the returns to education remain large well beyond early childhood. Teachers’ impacts on earnings are also similar in percentage terms for students from low and high income families. As a rough guideline, parents should be willing to pay about 25% of their child’s income at age 28 to switch their child from a below-average (25th percentile) to an above-average (75th percentile) teacher. For example, parents whose children will earn around $40,000 in their late 20s should be willing to pay $10,000 to switch from a below-average to an above-average teacher for one grade, based on the expected increase in their child’s lifetime earnings.

Overall, our study shows that great teachers create great value – perhaps several times their annual salaries – and that test score impacts are helpful in identifying such teachers. However, more work is needed to determine the best way to use VA for policy. For example, using VA in teacher evaluations could induce undesirable responses that make VA a poorer measure of teacher quality, such as teaching to the test or cheating. There will be much to learn about these issues from school districts that start using VA to evaluate teachers. Nevertheless, it is clear that improving the quality of teaching – whether using value-added or other tools – is likely to have large economic and social returns.

See, Annie Lowrey’s New York Times article, Big Study Links Good Teachers to Lasting Gain

Teachers also have some thoughts about effective teaching. Valerie Strauss of the Washington Post has a guest column written by teacher Larry Ferlazzo. In Teachers: What We Need to Do to Fix the Schools

Citation:

Executive Summary of National Bureau of Economic Research Working Paper No. 17699, December 2011

THE LONG-TERM IMPACTS OF TEACHERS: TEACHER VALUE-ADDED AND STUDENT OUTCOMES IN ADULTHOOD

Raj Chetty, Harvard University and NBER

John N. Friedman, Harvard University and NBER

Jonah E. Rockoff, Columbia University and NBER

Executive Summary

Manuscript (NBER         WP17699)

Presentation Slides

STATA Code

Every child has a right to a good basic education. In order to ensure that every child has a good basic education, there must be a quality teacher in every classroom.

See:

Is it true that the dumbest become teachers?

https://drwilda.wordpress.com/2011/12/09/is-it-true-that-the-dumbest-become-teachers/

A Review of the Literature Regarding Teacher’s Subject Matter Knowledge

The Importance of Teacher Disposition

The Guide to Teacher Quality

Teacher Quality

What Comprises High Quality Teacher Education?

Educational Testing Services’ Where We Stand on Teacher Quality

Dr. Wilda says this about that ©

 

Tags: , , , , , , ,

Washington D.C. rolls out merit pay

2 Jan

All politics is local.

Thomas P. O’Neill

Moi would like to modify that quote a bit to all education is local and occurs at the neighborhood school. We really should not be imposing a straight jacket on education by using a one-size-fits-all approach. Every school, in fact, every classroom is its own little microclimate. We should be looking at strategies which work with a given population of children.

A Healthy Child In A Healthy Family Who Attends A Healthy School In A Healthy Neighborhood. ©

Teachers and schools have been made TOTALLY responsible for the education outcome of the children, many of whom come to school not ready to learn and who reside in families that for a variety of reasons cannot support their education. All children are capable of learning, but a one-size-fits-all approach does not serve all children well. Different populations of children will require different strategies and some children will require remedial help, early intervention, and family support to achieve their education goals. There should also be different strategies about teacher compensation. Washington D.C. is trying out a merit pay system.

Sam Dillion reports in the New York Times article, In Washington, Large Rewards in Teacher Pay:

During her first six years of teaching in this city’s struggling schools, Tiffany Johnson got a series of small raises that brought her annual salary to $63,000, from about $50,000. This year, her seventh, Ms. Johnson earns $87,000.

That latest 38 percent jump, unheard of in public education, came after Ms. Johnson was rated “highly effective” two years in a row under Washington’s new teacher evaluation system. Those ratings also netted her back-to-back bonuses totaling $30,000.

“Lots of teachers leave the profession, but this has kept me invested to stay,” said Ms. Johnson, 29, who is a special-education teacher at the Ron H. Brown Middle School in Northeast Washington. “I know they value me.”

That is exactly the idea behind what admirers consider the nation’s most advanced merit pay system for public school teachers. This fall, the District of Columbia Public Schools gave sizable bonuses to 476 of its 3,600 educators, with 235 of them getting unusually large pay raises.

“We want to make great teachers rich,” said Jason Kamras, the district’s chief of human capital….

“The most important role for incentives is in shaping who enters the teaching profession and who stays,” said Eric A. Hanushek, a professor of economics at the Hoover Institution at Stanford University. “Washington’s incentive system will attract talented teachers, and it’ll help keep the best ones.”

Under the system, known as Impact Plus, teachers rated “highly effective” earn bonuses ranging from $2,400 to $25,000. Teachers who get that rating two years in a row are eligible for a large permanent pay increase to make their salary equivalent to that of a colleague with five more years of experience and a more advanced degree.

Those rewards come with risk: to receive the bonuses and raises, teachers must sign away some job security provisions outlined in their union contract. About 20 percent of the teachers eligible for the raises this year and 30 percent of those eligible for bonuses turned them down rather than give up those protections.

One persistent critic of the system is Nathan Saunders, president of the Washington Teachers Union, who argues that the evaluations do not adequately take into account the difficulties of working in poor neighborhoods. He also says that performance pay inappropriately singles out stars.

“This boutique program discourages teachers from working together,” Mr. Saunders said. http://www.nytimes.com/2012/01/01/education/big-pay-days-in-washington-dc-schools-merit-system.html?_r=1&emc=eta1

It is interesting that some eligible teachers decided not to participate in the program.

Dave Eggers and NÍnive Clements Calegari have a provocative article in the New York Times, The High Cost of Low Teacher SalariesThe Center for American Progress has a report by Frank Adamson and Linda Darling Hammond which discusses the importance of teacher pay.

In the report, Speaking of Salaries: What It Will Take to Get Qualified, Effective Teachers In All Communities Adamson and Darling- Hammond write:

As Education Trust President Kati Haycock has noted, the usual statistics about teacher credentials, as shocking as they are, actually understate the degree of the problem in the most impacted schools:

The fact that only 25% of the teachers in a school are uncertified doesn’t mean that the other 75% are fine. More often, they are either brand new, assigned to teach out of field, or low-performers on the licensure exam … there are, in other words, significant numbers of schools that are essentially dumping grounds for unqualified teachers – just as they are dumping grounds for the children they serve….

Download this report (pdf)

Download the executive summary (pdf)

Teacher compensation is important to retaining quality teachers.

Melanie Smollin has an excellent post at Take Part, Five Reasons Why Teacher Turnover Is On The Rise

With approximately 1.6 million teachers set to retire in the next decade, replenishing America’s teaching force should be a top priority. But filling classrooms with new teachers is only half the battle. Retaining them is equally important.

Numerous studies show that teachers perform best after being in the classroom for at least five years. According to a McKinsey study, 14 percent of American teachers leave after only one year, and 46 percent quit before their fifth year. In countries with the highest results on international tests, teacher turnover rates are much lower—around 3 percent.

This constant cycling in and out of new teachers is a costly phenomena. Students miss being taught by experienced educators, and schools and districts nationwide spend about $2.2 billion per year recruiting and training replacements.

Why are so many new teachers fleeing the profession after so few years in the classroom? Here are the top five reasons teacher turnover is an ongoing challenge:

5. BURNOUT: A recent U.C. Berkeley study of Los Angeles charter schools found unusually high rates of teacher turnover. At the 163 charter schools studied, teacher turnover hovered around 40 percent, compared to 15 percent at traditional public schools.

Since demands on charter school educators are seemingly boundless, including extended hours, researchers theorized, burnout is a viable explanation for the teacher exodus. “We have seen earlier results showing that working conditions are tough and challenging in charter schools,” explained U.C. Berkeley’s Bruce Fuller. “Charter teachers wear many hats and have many duties and are teaching urban kids, challenging urban kids, but we were surprised by the magnitude of this effect.”

4.THREAT OF LAYOFFS: In response to annual budget shortfalls, districts nationwide have sent pink slips to tens of thousands of teachers each spring for the past four years. In 2011, California sent out 30,000.

Retired teacher and author Jaime O’Neill believes this ongoing threat to job security has a destabilizing effect. As a new teacher, he wrote, you can expect your job “threatened each and every year when the annual state budget reveals once more that big cuts to education are coming, that you’ve been pink slipped until or unless there’s a last-minute reprieve. That yearly panic will cause you to wonder why you ever went into teaching in the first place, and you will surely make plans to seek other employment with each mention of just how precarious your employment is.”

3. LOW WAGES: U.S. Secretary of Education Arne Duncan recently said that teachers should earn between $60,000 and $150,000 per year. That’s a far cry from the current national average starting salary for teachers, which is $35,139.

Linda DeRegnaucourt, an accomplished high school math teacher, told CNN that after working for five years without a raise, and taking home an annual salary of $38,000, she simply cannot afford to continue doing the job she loves. DeRegnaucourt, like many other teachers, will leave the profession to pursue a more lucrative career.

2. TESTING PRESSURE: Since the No Child Left Behind Act was introduced in 2001, standardized test scores in math and reading have become the most important accountability measure used to evaluate schools.

Studies show that pressure to raise student test scores causes teachers to experience more stress and less job satisfaction. Many educators resent narrowing curriculum and stifling creativity in favor of teaching to the test.

On the National Center for Education Information’s “Profile of Teachers in the U.S. 2011,” the majority of comments submitted by survey respondents were “expressions of strong opposition to the current emphasis on student testing.”

As states increasingly rely on standardized test scores to evaluate individual educators, determine teacher pay and make lay-off decisions, testing pressure will only increase.

1. POOR WORKING CONDITIONS: When the Gates foundation polled 40,000 teachers about job satisfaction, the majority agreed that supportive leadership, time for collaboration, access to high quality curriculum and resources, clean and safe buildings, and relevant professional development were even more important than higher salaries.

But working conditions in many public schools remain far from this ideal—especially for beginning teachers, who are most likely to be assigned to the highest-need schools. Despite the added challenges they face, these teachers are often given few resources and little professional support.

Marguerite Roza and Sarah Yatsko from the University of Washington’s Center on Reinventing Education have an interesting February 2010 policy brief.

In Beyond Teacher Reassignments: Better Ways School Districts Can Remedy Salary Inequities Across Schools Districts Roza and Yatsko report:

Inside nearly all large school districts, the most experienced and highly paid teachers congregate in the more affluent schools. The opposite takes place in the poorer schools, where teachers tend to be more junior and lower paid, and teacher turnover is higher. Financially, this maldistribution means that a larger share of the district’s salary dollars are spent on the more affluent schools, and conversely, the poorer schools with lower salaries draw down less funds per pupil. The problem, of course, is that the resulting dollar allocation patterns work to reinforce achievement gaps, not address them….

This brief addresses this concern by demonstrating that districts would NOT need to mandatorily reassign teachers. It shows that there are other ways to restructure allocations that do not systematically shortchange the neediest schools. Discussed here are four options that districts could pursue to remedy school spending inequities created by uneven salaries:

  • Option 1: Apply teacher salary bonuses to some schools to balance salaries

  • Option 2: Vary class size across schools to level spending

  • Option 3: Concentrate specialist and support staff in schools with lower-salaried teachers

  • Option 4: Equalize per-pupil dollar allocations

Download Full Report (PDF: 736 K)

The goal of putting a quality teacher in every classroom depends upon preserving the ranks of quality teachers during times of tight budgets.

Dr. Wilda says this about that ©

 

Tags: , , , , , ,

What , if anything, do education tests mean?

27 Nov

Moi received a review copy from Princeton University Press of Howard Wainer’s Uneducated Guesses. The publication date was September 14, 2011. In the preface Wainer states the goal of the book, “It deals with education in general and the use of tests and test scores in support of educational goals in particular.” Wainer tries to avoid not only the policy, but the ethical analysis of the analysis of the improper use of tests and test results by tightly defining the objective of the book at page four. The policy implications of using tests and test results to not only decide the direction of education, but to decide what happens to the participants in education are huge. Moi wonders if Wainer was really trying to avoid the unavoidable?

For moi, the real meat of the book comes in chapter 4. Wainer says:

In chapter 3 we learned that the PSAT, the shorter and easier version of the SAT, can be used effectively as one part of the selection decision for scholarships. In this chapter we expand on this discussion to illustrate that the PSAT also provides evidence that can help us allocate scarce educational resources…. [Emphasis Added]

Wainer examines the connection by analyzing and comparing test results from three high school districts. Those schools are Garfield High School in L.A., the site of the movie “Stand and Deliver.” La Canada High School in an upscale L.A. Suburb and Detroit, a very poor inner city school district. The really scary policy implication of Wainer’s very thorough analysis is found at page 44, “Limited resources mean that choices must be made.” Table 4-4 illustrates that real life choices are being made by districts like Detroit. What is really scary is that these choices affect the lives of real human beings. Of course, Wainer is simply the messenger and can’t be faulted for his analysis. According to Wainer, it is very tricky to use test results in predicting school performance and his discussion at page 53 summarizes his conclusions.

Perhaps the most chilling part of Wainer’s book is chapter 8 which deals with how testing and test results can adversely impact the career of a teacher when so-called “experts” incorrectly analyze test data. It should be required reading for those who want to evaluate teacher performance based upon test results.

Overall, Uneducated Guesses is a good, solid, and surprisingly readable book about test design, test results, and the use of test results. The truly scary part of the book describes how the uninformed, unknowing, and possibly venal can use what they perceive to be the correct interpretation to make policy judgments which result in horrific societal consequences.

Wainer makes statistics as readable as possible, because really folks, it is still statistics.

Here is the full citation for the book:

Uneducated Guesses: Using Evidence to Uncover Misguided Education Policies

Howard Wainer

Cloth: $24.95 ISBN: 9780691149288

200pp.

Wainer’s book will come in handy when reading Eric A. Hanushek’s analysis of a National Research Council report.

Joy Resmovits writes about Eric A. Hanushek’s analysis of a National Research Council report in the Huffington Post article, Stanford Economist Rebuts Much-Cited Report That Debunks Test-Based Education:

When the National Research Council published the results of a decade-long study on the effects of standardized testing on student learning this summer, critics who have long opposed the use of exams as a teaching incentive rejoiced.

But Eric Hanushek, a Stanford University economist who is influential in education research, now says the “told you so” knee-jerk reaction was unwarranted: In an article released Monday by Harvard University’s journal Education Next, Hanushek argues that the report misrepresents its own findings, unjustifiably amplifying the perspective of those who don’t believe in testing. His article has even caused some authors of the NRC report to express concerns with its conclusions….

According to Hanushek’s analysis, the panel’s thorough examination of multiple studies is not evident in its conclusions.

“Instead of weighing the full evidence before it in the neutral manner expected of an NRC committee, the panel selectively uses available evidence and then twists it into bizarre, one might say biased, conclusions,” Hanushek wrote.

The anti-testing bias, he says, comes from the fact that “nobody in the schools wants people looking over their shoulders.”

Hanushek, an economist, claims that the .08 standard deviation increase in student learning is not as insignificant as the report makes it sound. According to his calculations, the benefits of such gains outweigh the costs: that amount of learning, he claims, translates to a value of $14 trillion. He notes that if testing is expanded at the expense of $100 per student, the rate of return on that investment is 9,189 percent. Hanushek criticized the report for not giving enough attention to the benefits NCLB provided disadvantaged students.

The report, Hanushek said, hid that evidence.

“They had that in their report, but it’s buried behind a line of discussion that’s led everybody who’s ever read it to conclude that test-based accountability is a bad idea,” he said. Hanushek reacted strongly, he said, because of the “complacency of many policymakers” who say education should be improved but that there are no effective options.

http://www.huffingtonpost.com/2011/11/23/eric-hanushek-rebuts-much_n_1108690.html?ref=email_share

Citation:

Grinding the Antitesting Ax: More bias than evidence behind NRC panel’s conclusions
Eric A. Hanushek,Education Next, WINTER 2012 / VOL. 12, NO. 2

Incentives and Test-Based Accountability in Education: A report from the National Research Council Checked by Eric A. Hanushek

http://educationnext.org/grinding-the-antitesting-ax/

One of the reasons why Hanushek’s critique is so important, aside from the implications that testing has under No Child Left Behind, is the push to use student test results in teacher evaluation. Valerie Strauss has an article in the Washington Post about a study which questions the use of student testing in the teacher evaluation process and the article includes links to the full report. In Study Blast Popular Teacher Evaluation Method Strauss reports:

Student standardized test scores are not reliable indicators of how effective any teacher is in the classroom, not even with the addition of new “value-added” methods, according to a study released today. It calls on policymakers and educators to stop using test scores as a central factor in holding teachers accountable.

“Value-added modeling” is indeed all the rage in teacher evaluation: The Obama administration supports it, and the Los Angles Times used it to grade more than 6,000 California teachers in a controversial project. States are changing laws in order to make standardized tests an important part of teacher evaluation.

Unfortunately, this rush is being done without evidence that it works well. The study, by the Economic Policy Institute, a nonpartisan nonprofit think tank based in Washington, concludes that heavy reliance on VAM methods should not dominate high-stakes decisions about teacher evaluation and pay.

Here is the report link

Sarah Garland of the Hechinger Report has written the article, Should value-added teacher ratings be adjusted for poverty?

In Washington, D.C., one of the first places in the country to use value-added teacher ratings to fire teachers, teacher-union president Nathan Saunders likes to point to the following statistic as proof that the ratings are flawed: Ward 8, one of the poorest areas of the city, has only 5 percent of the teachers defined as effective under the new evaluation system known as IMPACT, but more than a quarter of the ineffective ones. Ward 3, encompassing some of the city’s more affluent neighborhoods, has nearly a quarter of the best teachers, but only 8 percent of the worst.

The discrepancy highlights an ongoing debate about the value-added test scores that an increasing number of states—soon to include Florida—are using to evaluate teachers. Are the best, most experienced D.C. teachers concentrated in the wealthiest schools, while the worst are concentrated in the poorest schools? Or does the statistical model ignore the possibility that it’s more difficult to teach a roomfull of impoverished children?

Saunders thinks it’s harder for teachers in high-poverty schools. “The fact that kids show up to school hungry and distracted and they have no eyeglasses and can’t see the board, it doesn’t even acknowledge that,” he said.

http://hechingerreport.org/content/should-value-added-teacher-ratings-be-adjusted-for-poverty_6899/

The question is what do test results mean and more importantly, how are test scores to be used? Wainer’s book attempts to analyze these questions.

Citation:

Should value-added teacher ratings be adjusted for poverty?

Sarah Garland, The Hechinger Report, November 22, 2011

http://hechingerreport.org/content/should-value-added-teacher-ratings-be-adjusted-for-poverty_6899/

Every population of kids is different and they arrive at school at various points on the ready to learn continuum. Schools and teachers must be accountable, but there should be various measures of judging teacher effectiveness for a particular population of children. Perhaps, more time and effort should be spent in developing a strong principal corps and giving principals the training and assistance in evaluation and mentoring techniques. There should be evaluation measures which look at where children are on the learning continuum and design a program to address that child’s needs.

Dr. Wilda says this about that ©

Tags: , , , , , ,

Newer Entries →