Tag Archives: Measuring Teacher Effectiveness A Look “Under the Hood” of Teacher Evaluation in 10 Sites

Study: Performance of teachers can be tracked over time

5 Mar

Moi wrote in Report: Measuring teacher effectiveness:

Public Impact has a produced a report, Measuring Teacher Effectiveness: A Look “Under the Hood” of Teacher Evaluation in 10 Sites which examines teacher evaluation efforts in three states. So, how is teacher effectiveness measured? Well, kids know good teaching when they see it. Donna Gordon Blankinship of AP reports in the Seattle Times article, How Do You Find An Effective Teacher? Ask A Kid

Adults may be a little surprised by some of the preliminary findings of new research on what makes a great teacher.

How do you find the most effective teachers? Ask your kids. That’s one of four main conclusions of the Bill & Melinda Gates Foundation and its research partners after the first year of its Measures of Effective Teaching Project.

Preliminary results of the study were posted online Friday; a more complete report is expected in April, according to the foundation….

The first four conclusions of the study are as follows:

-The average student knows effective teaching when he or she experiences it.

-In every grade and every subject, a teacher’s past success in raising student achievement on state tests is one of the strongest predictors of his or her ability to do so again.

-The teachers with the highest value-added scores on state tests, which show improvement by individual students during the time they were in their classroom, are also the teachers who do the best job helping their students understand math concepts or demonstrate reading comprehension through writing.

-Valid feedback does not need to come from test scores alone. Other data can give teachers the information they need to improve, including student opinions of how organized and effective a teacher is….

See, Students Know Good Teaching When They Get It, Survey Finds

https://drwilda.com/2012/06/13/report-measuring-teacher-effectiveness/

Sarah D. Sparks reports in the Education Week article, Best and Worst Teachers Can Be Flagged Early, Says Study:

New teachers become much more effective with a few years of classroom experience, but a working paperRequires Adobe Acrobat Reader by a team of researchers suggests the most—and least—effective elementary teachers show their colors at the very start of their careers.

“This is a fundamentally different time period for teachers, when we know they are going through changes,” said lead author Allison Atteberry, a research associate in the Center on Education Policy and Workforce Competitiveness at the University of Virginia in Charlottesville. She discussed preliminary results of the study at a research meeting on K-12 and postsecondary education held by the Washington-based National Center for Analysis of Longitudinal Data in Education Research, known as CALDER, on Feb. 21.

“We know less about how these value-added measures work in the early career,” she added.

The study tracked the individual effectiveness of more than 7,600 incoming New York City teachers in mathematics and English/language arts. Each of the teachers taught 4th or 5th grade from 2000 to 2006.

The researchers analyzed teacher records from the New York city and state education departments, along with data on the teachers’ students, including achievement-test results in math and English/language arts, gender, ethnicity, home language, poverty, special education status, and absences and suspensions.

Predicting Performance

While incoming New York City teachers became more effective at improving their students’ mathematics and English/language arts performance in their first few years on the job, new research finds that they’re often still in the same performance quintile after four or five years. Researchers compared the mean effectiveness in the first two years with effectiveness in later years.

Ms. Atteberry’s co-authors are Susanna Loeb, the director of Stanford University’s Center for Education Policy Analysis, and James H. Wyckoff, an education professor at the University of Virginia. They and Ms. Atteberry are all associated with CALDER.

For the incoming teachers who continued to teach for at least five years, the researchers compared the mean value-added effectiveness at improving student achievement in math and English in their first two years of teaching with their effectiveness for the next three years.

Overall, the teachers improved significantly in their first two years in their value-added score. While more than 36 percent of teachers were rated in the lowest of five levels of effectiveness at the start of their careers, only 12 percent were still rated in that same quintile by their third year of teaching.

Limited Growth?

However, when teachers at each initial level of effectiveness were tracked individually over time, their growth was much less significant. Compared with other teachers who started at the same time they did, teachers in the lowest 20 percent were still likely to be in the lowest 20 percent three to five years later.

“When you look at teachers who in the future are low-performing, very few of those come from the initially highest quintile of performance, and the same is true in the opposite direction,” Ms. Atteberry said. “We see that even more at the high end: Teachers who are initially highest-performing are by far the most likely to be in the highest quintile in the future….” http://www.edweek.org/ew/articles/2013/03/06/23teacher.h32.html?tkn=MOYFY6ibw6ZMewuL2mU5P2GmWgqqd0wVbbr2&cmp=clp-edweek&intc=es

Citation:

Do First Impressions Matter? Improvement in Early Career Teacher Effectiveness

Allison Atteberry, Susanna Loeb, and James Wyckoff

CALDER Working Paper No. 90

February 2013

Abstract

There is increasing agreement among researchers and policymakers that teachers vary widely in their ability to improve student achievement, and the difference between effective and ineffective teachers hassubstantial effects on standardized test outcomes as well as later life outcomes. However, there is notsimilar agreement about how to improve teacher effectiveness. Several research studies confirm that onaverage novice teachers show remarkable improvement in effectiveness over the first five years of their careers. In this paper we employ rich data from New York City to explore the variation among teachers in early career returns to experience. Our goal is to bet ter understand the extent to which measures of teacher effectiveness during the first two years reliably predicts future performance. Our findings suggest that early career returns to experience may provide useful insights regarding future performance and offer opportunities to better understand how to improve teacher effectiveness. We present evidence not only about the predictive power of early value-added scores, but also on the limitations and imprecision of those predictions. http://auth.calder.commonspotcloud.com/publications/upload/wp90.pdf

Every population of kids is different and they arrive at school at various points on the ready to learn continuum. Schools and teachers must be accountable, but there should be various measures of judging teacher effectiveness for a particular population of children. Perhaps, more time and effort should be spent in developing a strong principal corps and giving principals the training and assistance in evaluation and mentoring techniques. Really, it comes down to each population of kids should have solutions tailored for their needs. There really should not be a one size approach to education.

Related:

Is classroom practice the missing ingredient in teacher training?                                                                     https://drwilda.com/2012/10/04/is-classroom-practice-the-missing-ingredient-in-teacher-training/

The teacher master’s degree and student achievement https://drwilda.com/2012/07/23/the-teacher-masters-degree-and-student-achievement/

Urban teacher residencies                                            https://drwilda.wordpress.com/2012/03/04/urban-teacher-residencies/

Where information leads to Hope. ©                 Dr. Wilda.com

Dr. Wilda says this about that ©

Blogs by Dr. Wilda:

COMMENTS FROM AN OLD FART©                         http://drwildaoldfart.wordpress.com/

Dr. Wilda Reviews ©                                                        http://drwildareviews.wordpress.com/

Dr. Wilda ©                                                                                      https://drwilda.com/

National Education Policy Brief: Designing teacher evaluations

25 Sep

Teacher evaluation is a hot topic. Moi wrote in Report: Measuring teacher effectiveness:

Public Impact has a produced a report, Measuring Teacher Effectiveness: A Look “Under the Hood” of Teacher Evaluation in 10 Sites which examines teacher evaluation efforts in three states. So, how is teacher effectiveness measured? Well, kids know good teaching when they see it. Donna Gordon Blankinship of AP reports in the Seattle Times article, How Do You Find An Effective Teacher? Ask A Kid

Adults may be a little surprised by some of the preliminary findings of new research on what makes a great teacher.

How do you find the most effective teachers? Ask your kids. That’s one of four main conclusions of the Bill & Melinda Gates Foundation and its research partners after the first year of its Measures of Effective Teaching Project.

Preliminary results of the study were posted online Friday; a more complete report is expected in April, according to the foundation….

The first four conclusions of the study are as follows:

-The average student knows effective teaching when he or she experiences it.

-In every grade and every subject, a teacher’s past success in raising student achievement on state tests is one of the strongest predictors of his or her ability to do so again.

-The teachers with the highest value-added scores on state tests, which show improvement by individual students during the time they were in their classroom, are also the teachers who do the best job helping their students understand math concepts or demonstrate reading comprehension through writing.

-Valid feedback does not need to come from test scores alone. Other data can give teachers the information they need to improve, including student opinions of how organized and effective a teacher is….

See,Students Know Good Teaching When They Get It, Survey Finds https://drwilda.com/2012/06/13/report-measuring-teacher-effectiveness/

Dr William Mathis of the University of Colorado Boulder School of Education has written a policy brief which focuses on teacher evaluation.

Here is the press release for Research-Based Options for Education Policy Making:

New Brief Offers Suggestions for Teacher Evaluation Design

Contact

William J. Mathis, (802) 383-0058, wmathis@sover.net

URL for this press release: http://tinyurl.com/9x5wrws

BOULDER, CO (September 20, 2012) –The first in a new series of two-page briefs summarizing the state of play in education policy research offers suggestions for policymakers designing teacher evaluation systems.

The paper is written by Dr. William Mathis, managing director of the National Education Policy Center, housed at the University of Colorado Boulder School of Education.

Mathis summarizes research findings on the effects of teacher evaluation systems, including unintended as well as intended consequences. At a time when teacher evaluation controversies in New York City, Los Angeles, Chicago and other school districts have erupted—particularly over the issue of evaluations based in part on the growth of students’ test scores—understanding the evidence about these issues has taken on new urgency.

Mathis counsels that lawmakers should be wary of approaches based in large part on test scores, because of three problems:
1.      The measurement error is large—which results in many teachers being incorrectly labeled as effective or ineffective;
2.      Given that only certain grade levels and subject areas are tested, relevant test scores are not available for most teachers; and
3.      The incentives created by the high-stakes use of test scores drive undesirable teaching practices such as curriculum narrowing and teaching to the test.

Instead, he advocates systems like peer assistance and review (PAR) that de-emphasize test scores. Such systems are more labor intensive but that have “far greater potential to enrich instruction and improve education.” He also advocates balancing summative, high-stakes assessment systems “with formative approaches that identify strengths and weaknesses of teachers and directly focus on developing and improving their teaching.”

In any case, “Given the extensive range of activities, skills, and knowledge involved in teachers’ daily work, the system’s goals must be clear, explicit and reflect practitioner involvement,” Mathis says.

This two-page brief is part of Research-Based Options for Education Policymaking, a multipart brief that takes up a number of important policy issues and identifies policies supported by research. Each section focuses on a different issue, and its recommendations to policymakers are based on the latest scholarship.

Find William Mathis’s brief on the NEPC website at:
http://nepc.colorado.edu/publication/options-teacher-evaluations

The mission of the National Education Policy Center is to produce and disseminate high-quality, peer-reviewed research to inform education policy discussions. We are guided by the belief that the democratic governance of public education is strengthened when policies are based on sound evidence.  For more information on the NEPC, please visit http://nepc.colorado.edu/.

This brief is also found on the GLC website at http://www.greatlakescenter.org/

Citation:

William J. Mathis

September 20, 2012

Research-Based Options for Education Policy Making is a 10-part brief that takes up important policy issues and identifies policies supported by research.  Each section focuses on a different issue, and its recommendations for policymakers are based on the latest scholarship. 

Introduction

Section 1:  Teacher Evaluation.  After reviewing different types of evaluative methods, Mathis points out the importance of using a combination of methods, of including all stakeholders in decision-making about evaluation systems, and of investing in the evaluation system

Section 2:  Common Core State Standards    

Section 3:  Preschool Education

Section 4:  Effective School Expenditures

Section 5:  Funding Formulas and Choice

Section 6:  English Language Learners Parent Involvement

Section 7:  Dropout Strategies

Section 8:  21st Century College and Career Ready

Section 9:  LGBT Safety Policies

Section 10:  Detracking

Policy Brief Download

The Center has produced a report, which focuses on teacher evaluation.Teacher Evaluation  Proper evaluation seems to be key to both addressing many problems teacher tenure was developed to protect from faulty evaluation of a teacher and to improve the quality of those in the teaching profession. Evaluation is just one component, however. New teachers need a proper induction into the profession and mentors to help them hone their skills and methods of teaching. If problems emerge, teachers need proper training and coaching to progress.

Related:

Study: Teacher merit pay works in some situations https://drwilda.com/2012/07/27/study-teacher-merit-pay-works-in-some-situations/

Manhattan Institute study: Evidence that ‘value-added modeling’ may be effective                                                         https://drwilda.com/2012/09/08/manhattan-institute-study-evidence-that-value-added-modeling-may-be-effective/

The attempt to evaluate teacher colleges is getting nasty  https://drwilda.wordpress.com/2012/02/05/523/

Dr. Wilda says this about that ©

Other blogs by Dr. Wilda:

COMMENTS FROM AN OLD FART ©   http://drwildaoldfart.wordpress.com/

Dr. Wilda Reviews ©                                          http://drwildareviews.wordpress.com/

Report: Measuring teacher effectiveness

13 Jun

Public Impact has a produced a report, Measuring Teacher Effectiveness: A Look “Under the Hood” of Teacher Evaluation in 10 Sites which examines teacher evaluation efforts in three states. So, how is teacher effectiveness measured? Well, kids know good teaching when they see it. Donna Gordon Blankinship of AP reports in the Seattle Times article, How Do You Find An Effective Teacher? Ask A Kid

Adults may be a little surprised by some of the preliminary findings of new research on what makes a great teacher.

How do you find the most effective teachers? Ask your kids. That’s one of four main conclusions of the Bill & Melinda Gates Foundation and its research partners after the first year of its Measures of Effective Teaching Project.

Preliminary results of the study were posted online Friday; a more complete report is expected in April, according to the foundation….

The first four conclusions of the study are as follows:

-The average student knows effective teaching when he or she experiences it.

-In every grade and every subject, a teacher’s past success in raising student achievement on state tests is one of the strongest predictors of his or her ability to do so again.

-The teachers with the highest value-added scores on state tests, which show improvement by individual students during the time they were in their classroom, are also the teachers who do the best job helping their students understand math concepts or demonstrate reading comprehension through writing.

-Valid feedback does not need to come from test scores alone. Other data can give teachers the information they need to improve, including student opinions of how organized and effective a teacher is….

See, Students Know Good Teaching When They Get It, Survey Finds

Here is the press release about ConnCan’s teacher effectiveness report which was produced by Public Impact:

New Report Analyzes How Multiple Measures Can Be Used to Evaluate Teacher Effectiveness

ConnCAN-Commissioned Report Looks at the Teacher Evaluation Implementation in 10 Sites, including New Haven, to Begin Charting Best Practice

FOR IMMEDIATE RELEASE — May 31, 2012

Contact:  Patrick Riccards, ConnCAN

Tel:  203-772-4017 x15

Email: patrick.riccards@conncan.org

New Haven, Conn

NEW HAVEN (May 31, 2012) – As states and school systems across the nation work to implement processes for evaluating educator effectiveness, a new research report offers a detailed look at 10 teacher evaluation models, looking at how they tackled key evaluation components such as student achievement measures, classroom evaluation, and other non-academic measures.

Conducted by Public Impact, Measuring Teacher Effectiveness: A Look “Under the Hood” of Teacher Evaluation in 10 Sites examines teacher evaluation efforts in three states (Delaware, Rhode Island, and Tennessee), five large districts (Hillsborough County, FL; Houston, TX; New Haven, CT; Pittsburgh, PA; and Washington, DC), one charter management organization (Achievement First), and the Relay Graduate School of Education. ConnCAN and 50CAN jointly commissioned the report, with support of the H.A. Vance Foundation.

There are few factors as important to student success than that of an effective educator,” ConnCAN CEO Patrick Riccards said. “To ensure that every child has that effective educator, we must implement comprehensive evaluation models. Measuring Teacher Effectiveness is an important tool in understanding what teacher evaluation leaders are doing and what components must be factored into a meaningful evaluation model.”

As part of this effort, Public Impact, ConnCAN, and 50CAN have provided a research brief, a cross-site analysis that looks across all 10 sites, 10 detailed profiles of the teacher evaluation systems in each of the featured sites, and a library of documents that are the building blocks of the 10 systems. All of these products can be found at: http://conncan.org/learn/research/teachers/measuring-teacher-effectiveness

The report pays particular attention to the design and implementation challenges that many states and districts face in putting an evaluation system into place. These challenges focused on five areas: 1) student achievement measures; 2) classroom observations; 3) other non-academic measures; 4) accuracy, validity, and reliability; and 5) reporting and using evaluation results.

Each site is working to continuously improve their evaluation systems with the belief that the challenges they encounter can be overcome. As Measuring Teacher Effectiveness reports, “None of these systems claims to have cracked the code for teacher evaluation. Nonetheless, we consistently heard that the perfect should not be the enemy of the good.”

There is no magic bullet when it comes to effective educator evaluation,” Riccards said. “But there is also no need to reinvent the wheel. By taking a close look at many of our evaluation trailblazers, we can see the necessary components for evaluation, the challenges our states and districts face in doing it right, and the unanswered questions we must still pursue if we are to provide all students with exemplary teachers.”

The findings of Measuring Teacher Effectiveness are particularly important as Connecticut is in the midst of developing the state evaluation model that will be in line with the teacher evaluation framework unanimously adopted by the Performance Evaluation Advisory Council (PEAC) in January 2012 and approved by the State Board of Education in February of 2012. This fall, the state plans to begin the evaluation pilot established under S.B. 458.

The analyses of New Haven Public Schools and Achievement First, in particular, provide policymakers, educators, and administrators with a solid understanding of the good work currently being done in Connecticut,” Riccards said. “These case studies, along with the other eight, serve as important tools in the completion of Connecticut’s educator evaluation system.”

Citation:

Doyle, D., & Han, J.G. (2012). Measuring teacher effectiveness: A look “under the hood” of teacher evaluation in 10 sites. New York: 50CAN; New Haven, CT: ConnCAN; and Chapel Hill, NC: Public Impact. Re­trieved from http://www.conncan.org/learn/research/teachers/measuring-teacher-effectiveness

©2012 50CAN, ConnCAN, and Public Impact

The authors encourage the free use, reproduction, and distribution of this paper for noncommer­cial use. We require attribution for all use. For more information and instructions on the commercial use of our materials, please contact us at http://www.publicimpact.com.

TO ORDER ADDITIONAL COPIES:

Please contact ConnCAN at info@conncan.org or 203 772 4017

ConnCAN

85 Willow Street

New Haven, CT 06511

http://www.conncan.org@conncan

Every population of kids is different and they arrive at school at various points on the ready to learn continuum. Schools and teachers must be accountable, but there should be various measures of judging teacher effectiveness for a particular population of children. Perhaps, more time and effort should be spent in developing a strong principal corps and giving principals the training and assistance in evaluation and mentoring techniques. Really, it comes down to each population of kids should have solutions tailored for their needs. There really should not be a one size approach to education.

Related:

The attempt to evaluate teacher colleges is getting nasty https://drwilda.wordpress.com/2012/02/05/523/

Dr. Wilda says this about that ©