Tag Archives: American Enterprise Institute

University of Illinois Urbana-Champaign study: Many education experts lack expertise

23 Feb

Reporters, seminar sponsors, political town halls often rely on “experts” to give an opinion about a particular issue. Education is an area populated by “experts” from all over the pedagogical and political spectrum. What exactly is an expert? The Legal Information Institute provides the legal definition of expert:

Rule 702. Testimony by Expert Witnesses
A witness who is qualified as an expert by knowledge, skill, experience, training, or education may testify in the form of an opinion or otherwise if:
(a) the expert’s scientific, technical, or other specialized knowledge will help the trier of fact to understand the evidence or to determine a fact in issue;
(b) the testimony is based on sufficient facts or data;
(c) the testimony is the product of reliable principles and methods; and
(d) the expert has reliably applied the principles and methods to the facts of the case.
Notes (Pub. L. 93–595, §1, Jan. 2, 1975, 88 Stat. 1937; Apr. 17, 2000, eff. Dec. 1, 2000; Apr. 26, 2011, eff. Dec. 1, 2011.) https://www.law.cornell.edu/rules/fre/rule_702

The legal definition provides some guidance.

Science Daily reported in the article, Education ‘experts’ cited in news stories may lack expertise, study finds:

The people most often cited as “education experts” in blogs and news stories may have the backing of influential organizations — but have little background in education and education policy, a new study suggests.

The findings are cause for concern because some prominent interest groups are promoting reform agendas and striving to influence policymakers and public opinion using individuals who have substantial media relations skills but little or no expertise in education research, say the authors of the study, Joel R. Malin and Christopher Lubienski, both at the University of Illinois.

To examine possible links between individuals’ media presence and their levels of expertise, Malin and Lubienski compiled a diverse list of nearly 300 people who appeared on the lists of experts prepared by several major education advocacy and policy organizations, including the conservative American Enterprise Institute and the liberal National Education Policy Center.
Malin and Lubienski also added to their sample a handful of scholars not on those lists but who are prominent and influential in the field of education.

Each person’s level of expertise was then scored using a formula that included their number of Google Scholar citations; their years of experience, calculated by subtracting the year they attained their highest degree from 2014; and whether or not the person had earned a doctoral or equivalent degree.

Each person’s level of media influence was calculated based upon the number of times they were quoted or mentioned in education press, U.S. newspapers or blogs during 2013; whether they had a Twitter profile; and their Klout score, which is a proxy for social media influence.
Experts were more likely to be quoted or mentioned in newspapers and blogs if they had higher scores on Google Scholar, Malin and Lubienski found. Every 1-point increase in an expert’s Google Scholar score was associated with a 1-percent increase in blog mentions.
Accordingly, each 1-point increase in years of experience corresponded with an increase of about 1 percent in newspaper citations, the researchers found.

However, affiliation with a policy or advocacy organization also substantially increased an expert’s media presence. People associated with the American Enterprise Institute were nearly 2.5 times more likely to be cited in education media.

Likewise, experts were 1.78 and 1.5 times more likely to be mentioned in blogs if they were affiliated with Cato or the American Enterprise Institute, respectively.

Although the initial list included 287 experts, Malin and Lubienski could not find the necessary information to estimate 52 of these individuals’ years of experience. More than half of these people were connected to organizations such as Cato and Heritage.

While the three people in the sample who were affiliated with Cato each received the maximum number of points for blog mentions, these individuals’ average estimated expertise score was 4.67 — substantially lower than the average score for the full sample, which was greater than 20. Perhaps the most troubling finding was that possession of a doctoral degree was associated with 67 percent fewer blog citations and 60 percent fewer newspaper mentions, and fewer Klout points, which indicates that academic researchers with empirical expertise in education are often far removed from popular and policy conversations, Malin and Lubienski said…. http://www.sciencedaily.com/releases/2015/02/150220133338.htm

Citation:

Education ‘experts’ cited in news stories may lack expertise, study finds
Date: February 20, 2015

Source: University of Illinois at Urbana-Champaign
Summary:
A study of education experts cited in news stories and blogs during 2013 finds that some lack background in education policy and research.
Educational Expertise, Advocacy, and Media Influence
Joel R. Malin, Christopher Lubienski

Abstract
The efforts of many advocacy organizations to advance their preferred policies despite conflicting evidence of the effectiveness of these policies raise questions about factors that shape successful policy promotion. While many may like to think that expertise on an issue in question is an essential prerequisite for influence in public policy discussions, there is a traditional disconnect between research evidence and policymaking in many fields, including education. Moreover, the efforts of many policy advocates suggest that they see advantages in other factors besides research expertise in advancing their interpretation of evidence for use in policymaking processes. We hypothesize that some of the most influential education-focused organizations are advancing their agendas by engaging media and drawing on individuals who possess substantial media acumen, yet may not possess traditionally defined educational expertise. Thus, we hypothesize that media impact is loosely coupled with educational expertise. In fact, in analyzing various indicators of expertise and media penetration, we find a weak relationship between expertise and media impact, but find significantly elevated media penetration for individuals working at a sub-sample of organizations promoting what we term “incentivist” education reforms, in spite of their generally lower levels of expertise. We find these organizations are particularly effective in engaging new media forms by going directly to their audience. We consider the policy implications in the concluding discussion.
Keywords
agenda setting; decision making; educational policy; expertise; information dissemination; political influences; politics
Full Text:
PDF http://epaa.asu.edu/ojs/article/view/1706/1456
Related Articles
Jabbar, H., Goldie, D., Linick, M., & Lubienski, C. (2014). Using bibliometric and social media analyses to explore the “echo chamber” hypothesis. Educational Policy, 28(2), 281-305. http://dx.doi.org/10.1177/0895904813515330

Lubienski, C., Scott, J., & DeBray, E. (2014). The politics of research use in education policymaking. Educational Policy, 28(2), 131-144. http://dx.doi.org/10.1177/0895904813515329

Henig, J. (2009). Politicization of evidence: Lessons for an informed democracy. Educational Policy, 23, 137-160. http://dx.doi.org/10.1177/0895904808328525

DOI: http://dx.doi.org/10.14507/epaa.v23.1706

Here is the press release from the University of Illinois:

Education ‘experts’ may lack expertise, study finds
2/20/2015 | Sharita Forrest, Education and Social Work Editor | 217-244-1072; slforres@illinois.edu

CHAMPAIGN, Ill. — The people most often cited as “education experts” in blogs and news stories may have the backing of influential organizations – but have little background in education and education policy, a new study suggests.

The findings are cause for concern because some prominent interest groups are promoting reform agendas and striving to influence policymakers and public opinion using individuals who have substantial media relations skills but little or no expertise in education research, say the authors of the study, Joel R. Malin and Christopher Lubienski, both at the University of Illinois.

To examine possible links between individuals’ media presence and their levels of expertise, Malin and Lubienski compiled a diverse list of nearly 300 people who appeared on the lists of experts prepared by several major education advocacy and policy organizations, including the conservative American Enterprise Institute and the liberal National Education Policy Center.

Malin and Lubienski also added to their sample a handful of scholars not on those lists but who are prominent and influential in the field of education.
Each person’s level of expertise was then scored using a formula that included their number of Google Scholar citations; their years of experience, calculated by subtracting the year they attained their highest degree from 2014; and whether or not the person had earned a doctoral or equivalent degree.
Each person’s level of media influence was calculated based upon the number of times they were quoted or mentioned in education press, U.S. newspapers or blogs during 2013; whether they had a Twitter profile; and their Klout score, which is a proxy for social media influence.

Experts were more likely to be quoted or mentioned in newspapers and blogs if they had higher scores on Google Scholar, Malin and Lubienski found. Every 1-point increase in an expert’s Google Scholar score was associated with a 1-percent increase in blog mentions.

Accordingly, each 1-point increase in years of experience corresponded with an increase of about 1 percent in newspaper citations, the researchers found.
However, affiliation with a policy or advocacy organization also substantially increased an expert’s media presence. People associated with the American Enterprise Institute were nearly 2.5 times more likely to be cited in education media.

Likewise, experts were 1.78 and 1.5 times more likely to be mentioned in blogs if they were affiliated with Cato or the American Enterprise Institute, respectively.
Although the initial list included 287 experts, Malin and Lubienski could not find the necessary information to estimate 52 of these individuals’ years of experience. More than half of these people were connected to organizations such as Cato and Heritage.

While the three people in the sample who were affiliated with Cato each received the maximum number of points for blog mentions, these individuals’ average estimated expertise score was 4.67 – substantially lower than the average score for the full sample, which was greater than 20.
Perhaps the most troubling finding was that possession of a doctoral degree was associated with 67 percent fewer blog citations and 60 percent fewer newspaper mentions, and fewer Klout points, which indicates that academic researchers with empirical expertise in education are often far removed from popular and policy conversations, Malin and Lubienski said.

“Our findings suggest that individuals with less expertise can often have greater success in media penetration,” said Malin, a curriculum specialist with the Pathways Resource Center and a doctoral candidate in educational administration and leadership at the university. “Although some individuals might not have formal training in research methods for analyzing the issues about which they are speaking, they possess skills and orientations that make them accessible and appealing to the media. And when these people are affiliated with organizations that have strong media arms or outreach efforts, they have the support and the incentive to engage broader and policy audiences.“
“Newer forms of media offer particularly useful opportunities for directly engaging audiences, while bypassing traditional forms of quality checks on expertise,” said Lubienski, a professor of education policy and director of the Forum on the Future of Public Education at the university. “We believe caution and consideration of individuals’ expertise are warranted when reporters and bloggers are researching topics and seeking insights – and when policymakers and laypersons are consuming media.”

Researchers who want to see their work have impact beyond the academic community must become more adept at communicating via traditional and new media. Otherwise, policy changes in education will be guided more by ideology and agendas than by research, Malin and Lubienski said.
The study was published in a recent issue of the journal Education Policy Analysis Archives.

Editor’s note: To reach Joel Malin, call 217-244-9390; email jrmalin2@illinois.edu.
To reach Christopher Lubienski, call 217-333-4382; email club@illinois.edu

The paper, “Educational Expertise, Advocacy, and Media Influence,” is available online or from the News Bureau. http://news.illinois.edu/news/15/0220expertise_JoelMalin_ChristopherLubienski.html

The point of this study is that critical thinking cannot be stressed enough when evaluating the validity or worth of any opinion.

“Incestuous, homogeneous fiefdoms of self-proclaimed expertise are always rank-closing and mutually self-defending, above all else.”

Glenn Greenwald

Where information leads to Hope. © Dr. Wilda.com

Dr. Wilda says this about that ©

Blogs by Dr. Wilda:

COMMENTS FROM AN OLD FART©
http://drwildaoldfart.wordpress.com/

Dr. Wilda Reviews ©
https://drwildareviews.wordpress.com/

Dr. Wilda ©
https://drwilda.com/

Center for American Progress Report: Mayoral control of schools

24 Mar

As more and more question the effectiveness of the current school structure, some mayors have assumed control of their city schools. Frederick M. Hess writes in the American Enterprise Institute article, Assessing the Case for Mayoral Control of Urban Schools:

Are elected school boards equal to the challenges of twenty-first-century urban school governance? Eli Broad, founder of the Broad Prize for Urban Education, believes in “mayoral control of school boards or . . . no school board at all.”[1] Chester E. Finn Jr., president of the Thomas B. Fordham Institute, has called school boards “an aberration, an anachronism, an educational sinkhole,” urging, “put this dysfunctional arrangement out of its misery.”[2]

Aberration or not, the nation’s nearly fifteen thousand school boards are still charged with providing the leadership, policy direction, and oversight to drive school improvement. Nationally, 96 percent of districts have elected boards, including more than two-thirds of the twenty-five largest districts.[3] After decades of largely ineffectual reform, however, it is far from clear that school boards are equal to the challenge. The most popular alternative is replacing today’s boards with some form of mayoral control. Cities with a variation of this arrangement today include Baltimore, Boston, Chicago, New York, Philadelphia, and Washington, D.C. The take-no-prisoners leadership styles of school chancellors in New York City and Washington, D.C., have drawn particular interest.

Where It All Began

The irony is that today’s school boards took their contemporary shape about a century ago, when Progressive Era reformers launched a concerted effort to expunge “politics” from schooling in the name of efficiency, equity, and accountability. As James Cibulka, president of the National Council for Accreditation of Teacher Education, has noted, K–12 governance was “designed by political Progressives early in the twentieth century to give professional educators authority and insulate them from political abuses.”[4] Consequently, even strong mayors had little influence over the local schools.

Early nineteenth-century school boards had been local and informal, justified by the presumption that they kept schools connected to their neighborhoods. By the dawn of the twentieth century, however, Progressives–in language that sounds more than a little familiar–thought it necessary to “clean out” boards plagued by patronage and politics. In 1885, Boston reformer John Philbrick asserted that “unscrupulous politicians” had seized “every opportunity to sacrifice the interests of the schools to the purposes of the political machine.”[5]

As the twentieth century dawned, Progressives worked to streamline boards and render them more professional and accountable. University of Chicago political scientist William Howell explains: “The order of the day put rational control and expertise in the service of objectivity and efficiency; the result was the birth of the civil service, the exaltation of meritocracy and modernity, and the rise of Taylorism, the scientific management of industries and businesses.”[6] Seeking to insulate board politics from rough-and-tumble state and national elections, Progressives moved board elections “off-cycle” and made them nonpartisan.

Efforts to separate education from politics gave rise to concerns that school systems were not apolitical but rather consumed by undisciplined, petty, and ineffectual politics. Assessing Progressive Era reforms more than thirty years ago, historian Charles Beard observed, “Cities change from one [approach] to the other in the hope–usually vain–of taking the school affairs out of the spoils system.”[7]

Today, reformers worry that excising politics from school governance has also removed coherence and accountability. One popular solution: put the politics back in education by handing control of the schools to the mayor or empowering mayors to appoint local school boards. This is primarily debated in the nation’s large, urban school systems–those cities where educational challenges are more daunting, politics are especially complex, and the need for coherence is particularly pressing. Is it a promising idea? What does the research suggest?                                       http://www.aei.org/article/education/assessing-the-case-for-mayoral-control-of-urban-schools/

The Center for American Progress has completed the report, Mayoral Governance and Student Achievement: How Mayor-Led Districts Are Improving School and Student Performance by Kenneth K. Wong and Francis X. Shen

Here is a summary of the Center for American Progress Report about mayoral control:

Top 5 Things to Know About Mayoral Control of Schools

By Juliana Herman | March 22, 2013

In many cities across America, it’s not just schools that are failing—it’s the entire school district as well. Huge numbers—if not the majority—of students throughout these districts are not reading at grade level and lack basic math skills.

This is a problem greater than any one school. In response, some cities have shaken up the way their school districts are run, giving greater control to their mayors and implementing what is called “mayoral control” of schools. School districts are traditionally controlled by a locally elected school board, which makes decisions about how schools are run, including hiring and firing the school superintendent. Mayoral control, however, is a shift in the power structure wherein mayors are given a greater degree of authority over schools. Often, though not always, mayors are given the power to appoint members who will replace some or all members of the elected school board.

The move to mayoral control is one element in the larger discussion about who should run our schools, but it is also a significant and potentially impactful alternative to the traditional structure—and it comes at a time when schools and students are desperate for alternatives.

The Center for American Progress recently released a new report analyzing the impact of mayoral control. The report, titled “Mayoral Governance and Student Achievement: How Mayor-led Districts Are Improving School and Student Performance” by Kenneth K. Wong and Francis X. Shen, looks at the impact of mayoral control on resource management and student achievement in 11 different school districts across the country.

Based on CAP’s new report, here are the top five things to know about mayoral control of schools:

It’s been done all across the country in cities of all sizes

Some variation of mayoral control has been implemented in a geographically diverse range of urban cities, from New York City to Indianapolis to Los Angeles and many places in between. These cities have different student populations, structures, and histories, but empowering the mayor to make at least some of the decisions about schools has been tried in all of them….

Mayoral control comes in many shapes and sizes

Despite what the name might imply, there is no “one and only” type of mayoral control. Different cities have taken different approaches, and new formats are still being invented. There is a lot of room for variation depending on local priorities, decisions, cultures, and any number of other factors. The term “mayoral control” simply signifies that the mayor has more power now than he or she did before. What that means in practice is up to the city or state in question.

There are, however, a few common forms or degrees of control. Some cities have given their mayor the power to appoint the entire school board and the CEO, or superintendent, of the school district. Examples of where this has happened include Washington, D.C., and Chicago. In New York City the mayor appoints the CEO and the majority—though not the entirety—of the board. Together, these three cities have “very high” degrees of mayoral control. Cities that empower the mayor to appoint at least the majority of the school board, but give the boards the authority to appoint the CEOs, fall into the high degree of control classification. This category—also the most common—includes Boston, Massachusetts; Cleveland, Ohio; Hartford, Connecticut; New Haven, Connecticut; Providence, Rhode Island; Trenton, New Jersey; and Yonkers, New York. Even within this category, there is variation: The mayors of Boston, Cleveland, and Providence must choose their board appointees from a list of nominees….

Mayor-led districts may use resources more strategically

There is evidence that districts operating under mayoral control may spend their money differently, more strategically, and with a greater focus on the classroom than districts governed by elected boards. For starters, mayoral-led districts have more resources per student overall than similar city districts, though the cause of this is hard to identify definitively. On average, districts under mayoral control also focus on teachers: A greater percentage of their total staff is teachers, producing lower student-to-teacher ratios. Relative to the largest city districts, mayor-led districts have less central office staff and administrators as a percent of their total staff. This prioritization on teaching and learning might be an important factor in contributing to higher student achievement…,

Mayor-controlled districts have seen increases in student achievement

Although other factors are important, the ultimate measure of any change in our education system is whether it improves student learning and achievement. In Boston, Chicago, New York City, Washington, D.C., and other cities, mayoral control is associated with just that. Students saw improvements—in some cases significant improvements—on both state assessments and on the National Assessment of Educational Progress, a test administered nationally to fourth and eighth graders. Looking at the National Assessment of Educational Progress scores, for example, the percentage of Bostonian fourth graders proficient in math went from 12 percent to 33 percent—an increase of 21 percentage points—under mayoral control. Similarly, the percentage of fourth graders in Washington, D.C. that were proficient in reading went from 10 percent to 20 percent—an increase of 10 percentage points—after the city moved to mayoral control….

It doesn’t work everywhere, but it can be a catalyst for reform

Mayoral control was less successful in cities such as Cleveland, Ohio, and Yonkers, New York. In Cleveland student achievement on the National Assessment of Educational Progress improved just slightly, if at all, and the gap between the average among large cities and the district’s achievement widened—not narrowed—for almost every grade, subject, and student population. This is exactly the opposite of closing the achievement gap. To be clear, it’s impossible to know why achievement stagnated in these cities, and certainly numerous factors other than mayoral control are involved. But it is important to recognize that mayoral control may not be the right solution for all districts….

Conclusion

Mayoral control of schools can be effective. Mayor-controlled districts have seen improved student achievement across all subjects and student groups. Moving to a mayor-led district can also help spur innovation and advancement. In cities with lagging student achievement, getting more engagement from mayors or increasing their authority over schools could be part of the solution. But voters and policymakers should be sure to design a variation of mayoral control that works for their city and consider the possibility that a different “shake up” strategy might be a better fit.

Juliana Herman is an Education Policy Analyst at the Center for American Progress. 

To speak with our experts on this topic, please contact:

Print: Katie Peters (economy, education, and health care)
202.741.6285 or kpeters1@americanprogress.org

Syracuse 2020 offers the concise pros and cons of mayoral school control:

MAYORAL CONTROL OF SCHOOLS

PROS

  • Promote gains in accountability and efficiency through increased testing and control of personnel operations
  • Clear goals and accountability resting with the mayor as opposed to boards with differing positions.
  • Better coordination with other agencies in terms of child welfare, safety, public health, recreation, job training, economic development and overall community development strategies
  • Ability to hire chief executive officers from outside of educational systems
  • Increased fiscal stability
  • More political participation because of broader voter participation in elections
  • Promotes the  idea of a progressive community
  • Potential for gaining political capital

CONS

  • Business approach does not recognize differences in public personnel and public service systems
  • Mayor’s power is diluted through necessary delegation of authority,
  • Schools are intense people centered organizations quite unlike treating sewage and collecting garbage.
  • Too reliant on idiosyncrasies of individual mayor
  • Better public oversight due to open board meetings
  • Results of mayoral control are unimpressive when matched to NAEP tests
  • Results of outside CEO’s uneven

http://www.syracuse2020.org/…/MAYORAL%20CONTROL%20OF%20SC

Moi wrote about school superintendents in Life expectancy of a superintendent: A lot of bullets and little glory:

Just about anyone in education has a tough job these days, from the building staff to the superintendent. There is pressure to perform in an environment of declining resources. Lately, the job of superintendent of large urban school districts has been characterized by turnover. Thomas E. Glass in The History of the Urban Superintendent writes:

The twenty-first century finds one-third of America’s public school children attending one of ten large urban (large-city) school districts. By 2020 approximately one-half of public school enrollment will be clustered in twenty districts. The educational stewardship of a majority of the nations youth rests uncomfortably on the shoulders of a very few large-city school superintendents. Their success and the success of their districts may very well determine the future of American democracy.

Urban districts are typically considered to be those located in the inner core of metropolitan areas having enrollments of more than 25,000 students. The research and literature about large-city school districts portray conditions of poverty, chronic academic underachievement, dropouts, crime, unstable school boards, reform policy churn, and high superintendent turnover.

The typical tenure of a superintendent in the largest large-city districts is two to three years. This brief tenure makes it unlikely a superintendent can develop and implement reform programs that can result in higher academic achievement–let alone re-build crumbling schools buildings, secure private sector assistance, and build a working relationship with the city’s political structure.

The large-city superintendency is a position defined by high expectations, intense stress, inadequate resources, and often a highly unstable politicized board of education.
Read more: Superintendent of Large-City School Systems – History of the Urban Superintendent, The Profession, School Boards,

Characteristics of the Large-City Superintendent http://education.stateuniversity.com/pages/2470/Superintendent-Large-City-School-Systems.html#ixzz0p6HySmU0

See, District Administration’s article, Superintendent Staying Power http://www.districtadministration.com/article/superintendent-staying-power

There is no one-size-fits all in education, there should be a variety of options.

See:

Ravitch: Mayoral control means zero accountability                                        http://voices.washingtonpost.com/answer-sheet/education-secretary-duncan/ravitch-mayoral-control-means.html

Resist Mayoral Control                                                                                                     http://communityeducationtaskforce.rocus.org/?page_id=2

Where information leads to Hope. ©     Dr. Wilda.com

Dr. Wilda says this about that ©

Blogs by Dr. Wilda:

COMMENTS FROM AN OLD FART©                      http://drwildaoldfart.wordpress.com/

Dr. Wilda Reviews ©                                             http://drwildareviews.wordpress.com/

Dr. Wilda ©                                                                                                      https://drwilda.com/