Académique Documents
Professionnel Documents
Culture Documents
Bertram Generlette,
formerly principal at
Piney Branch Elementary in
Takoma Park, Maryland, and now
principal at Montgomery Knolls Elementary
School in Silver Spring, Maryland.
62 ED U C A T I O N N E XT / W I N T E R 2 0 1 3 educationnext.org
research
It is widely believed that a good principal different points in time. From this, we are able to determine
is the key to a successful school. No Child Left Behind how much effectiveness varies from one principal to the next.
encouraged the replacement of the principal in persistently Our results indicate that highly effective principals raise the
low-performing schools, and the Obama administration achievement of a typical student in their schools by between
has made this a requirement for schools undergoing fed- two and seven months of learning in a single school year;
erally funded turnarounds. Foundations have invested ineffective principals lower achievement by the same amount.
millions over the past decade in New Leaders for New These impacts are somewhat smaller than those associated
Schools, an organization that recruits nontraditional prin- with having a highly effective teacher. But teachers have a
cipal candidates and prepares them for the challenges of direct impact on only those students in their classroom; differ-
school leadership. And the recently launched George W. ences in principal quality affect all students in a given school.
Bush Institute is making the principalship a focus of its We also investigate one widely discussed mechanism
activities. Yet until very recently there was little rigorous through which principals affect student achievement: the
research demonstrating the importance of principal quality management of teacher transitions. Importantly, because
for student outcomes, much less the spe- high teacher turnover can be associated with
cific practices that cause some principals to
be more successful than others. As is often Measuring both improvement and decline in the quality
of instruction, the amount of turnover on its
the case in education policy discussions, we own provides little insight into the wisdom of
have relied on anecdotes instead.
This study provides new evidence on the a principal’s personnel decisions. We confirm,
however, that teachers who leave schools with
the importance of school leadership by the most-successful principals are much more
estimating individual principals’ contribu-
tions to growth in student achievement. impact likely to have been among the less-effective
teachers in their school than teachers leaving
Our approach is quite similar to studies that schools run by less-successful principals.
measure teachers’ “value added” to student
achievement, except that the calculation is of effective The final component of our analysis con-
siders the dynamics of the principal labor
applied to the entire school. Specifically, we market, comparing the effectiveness of prin-
measure how average gains in achievement,
adjusted for individual student and school principals cipals who move on to those who stay in their
initial schools. Constrained by salary inertia
characteristics, differ across principals—both and the historical absence of good perfor-
in different schools and in the same school at mance measures, the principal labor market
does not appear to weed out those principals who are least Measuring Principal Quality
successful in raising student achievement. This is especially The fundamental challenge to measuring the impact of school
true in schools serving disadvantaged students. This is trou- leaders is separating their contributions from the many other
bling, as the demands of leading such schools, including the factors that drive student achievement. For example, a school
need to attract and retain high-quality teachers despite less that serves largely affluent families may create the illusion that
desirable working conditions, may amplify the importance it has a great principal, when family backgrounds are the key
of having an effective leader. cause of high achievement. Alternatively, a school that serves
disadvantaged students may appear to be doing poorly but in
fact have a great principal who is producing better outcomes
The Texas Database than any other principal would.
Our analysis relies on administrative data constructed Our basic value-added model measures the effectiveness of
as part of the University of Texas at Dallas (UTD) Texas a principal by examining the extent to which math achieve-
Schools Project. Working with the Texas Education Agency ment in a school is higher or lower than would be expected
(TEA), this project has combined different data sources to based on the characteristics of students in that school, includ-
create matched data sets of students, teachers, and principals ing their achievement in the prior year. Put another way, it
over many school years. The data include all Texas public- examines whether some schools have higher achievement
school teachers, administrators, staff, and students in each than other schools that serve similar students and attributes
year, permitting accurate descriptions of the schools led by that achievement difference to the principal. This approach is
each principal. very similar to that employed in studies that measure teacher
The Public Education Information Management System quality using databases tracking the performance of indi-
(PEIMS), TEA’s statewide database, reports key demographic vidual students over time.
data, including race, ethnicity, and gender for students and The main concern with this approach is that there may
school personnel, as well as student eligibility for subsidized be unmeasured factors that affect school performance. Our
lunch (a standard indicator of poverty). PEIMS also contains data contain only basic information on student background
detailed annual information on teacher and administrator characteristics, such as gender, race or ethnicity, and eligi-
experience, salary, education, class size, grade, population bility for subsidized lunch. As a result, we cannot control
served, and subject. Importantly, this database can be merged for more nuanced measures of students and their families,
with information on student achievement by school, grade, such as motivation or wealth. We are, however, able to con-
and year. Beginning in 1993, Texas schools have administered trol for students’ test scores from the previous year, which
the Texas Assessment of Academic Skills (TAAS) each spring may well capture a lot of the characteristics that we cannot
to eligible students in grades 3 through 8. Our analysis there- measure directly. Moreover, there are also school factors not
fore focuses on principals in elementary and middle schools, under the direct control of the school, including the quality
for whom it is possible to develop performance measures. of teachers inherited by the principal. Below we describe
The personnel data combine time as a teacher and as alternative approaches to isolating the contributions of the
an administrator into total experience, so it is not possible current principal.
to measure tenure as a principal accurately for those who In estimating principal effectiveness, we want to mini-
became a principal prior to the initial year of our data (the mize the influence of specific circumstances and look at the
1990–91 school year). We therefore concentrate on the years underlying stable differences in impacts. This issue is impor-
from 1995 to 2001. Over this period, we are able to observe tant because a principal’s impact may vary with tenure in a
7,420 individual principals and make use of 28,147 annual school. A principal’s impact on the quality of the teaching
principal observations. staff (whether negative or positive), for example, probably
64 ED U C A T I O N N E XT / W I N T E R 2 0 1 3 educationnext.org
research
PRINCIPALS BRANCH, HANUSHEK, & RIVKIN
increases over time as the share of teachers who were hired characteristics that are not under the principal’s control, such
on her watch rises. To account for any differences in effective- as the quality of the school building, or decisions made by
ness that are related to tenure as a principal in a given school, district administrators as well as unmeasured parental influ-
we begin our analysis by focusing on data from the first three ences. As a result, it may overestimate the amount of influence
years a principal leads a school. principals actually have.
This first analysis indicates that the standard deviation We begin to address this issue by measuring principal
of principal effectiveness is 0.21 standard deviations of test effectiveness based only on comparisons of within-school dif-
scores (see Table 1). This is a very large figure, perhaps unbe- ferences in student achievement growth over time. In simplest
lievably large, implying that a principal at the 75th percentile terms, we compare average student achievement gains in the
of this effectiveness measure shows average achievement same school under different principals. This method elimi-
gains of 0.11 standard deviations (relative to the average nates the influence of any student, school, or neighborhood
principal), while one at the 25th percentile shows average characteristics that do not change over time. Its main draw-
losses of 0.15 standard deviations. These differences are even back is that it ignores all differences in principal effectiveness
more pronounced in high-poverty schools, for which the between schools, potentially underestimating the amount of
gap between the 25th and 75th percentile principal is more variation in principal quality. For example, if each school
than one-third of a standard deviation. On average across all tends to attract principals who are similar in quality whenever
schools, the impact of having a principal 1 standard devia- it searches for a new principal, this approach will understate
tion more effective than the average principal is as much as the true extent of variation in principal effectiveness.
seven additional months of learning in a single academic year. We conduct this second analysis using all of the prin-
As noted above, this initial estimate of the variability in cipals in our data, not just those in their first three years
principal effectiveness may partly reflect differences in school leading a school, because the numbers of schools with
2. Difference in average
adjusted math achievement + 8 percentile points
gains between students All Texas principals 0.11
of student achievement
attending the same school
under different leaders
3. Additional year-to-year
fluctuation in average + 4 percentile points
adjusted achievement gains All Texas principals 0.05
surrounding a leadership of student achievement
transition
Note: The standard deviation of principal effectiveness is reported in standard deviations of student achievement. An effective principal is one at the
84th percentile of the quality distribution; an ineffective principal is one at the 16th percentile. The impact of an effective principal is reported for the
median student.
SOURCE: Authors’ calculations based on Texas Education Agency data
two months of additional learning. By comparison, previ- decisions, or are less successful in creating an environment
ous research suggests that a 1-standard-deviation increase that attracts and retains better teachers. Although better
in teacher quality raises achievement by somewhat more principals may also attract and hire more-effective teachers,
than 0.10 standard deviations. Teachers affect only their the absence of reliable quality measures for new teachers and
students, however, while principals affect all students in the fact that many principals have little control over new
a school. The overall impact from increasing principal hires lead us to focus specifically on turnover.
quality therefore substantially exceeds the benefit from Unfortunately, our data do not contain direct informa-
a comparable increase in the quality of a single teacher. tion on personnel decisions that would enable us to separate
Importantly, this estimate ignores all variation in principal voluntary and involuntary transitions, and existing evidence
66 ED U C A T I O N N E XT / W I N T E R 2 0 1 3 educationnext.org
research
PRINCIPALS BRANCH, HANUSHEK, & RIVKIN
The role of principals in fostering student learning is an important facet of education policy discussions. Strong leadership is viewed as
especially important for revitalization of failing schools.
suggests that teachers rather than principals initiate the which principals affect school quality. The fact that less-effec-
majority of transitions. In addition, the Texas data do not tive teachers are more likely to leave schools run by highly
match students to individual teachers, meaning that we must effective principals also validates our measure of principal
draw inferences about teacher effectiveness from average quality. If our measure was just capturing random noise in
information across an entire grade. the data rather than information about true principal qual-
With detailed information on teacher effectiveness and ity, we would not expect it to be related to teacher quality
transitions, we could investigate whether better principals and turnover.
are more likely to dismiss the least-effective teachers and
reduce the likelihood that the more-effective teachers depart
voluntarily. In the absence of such information, however, we Principal Transitions and Quality
focus on the relationship within schools between the share of Along with teacher turnover, instability of leadership is
teachers that exits each grade and the average value-added often cited as an impediment to improving high-poverty
to student achievement in the grade. We examine how this and low-performing schools. Consistent with these con-
varies with our measures of principal quality based on stu- cerns, we find that Texas schools with a high proportion
dent achievement gains. For example, in a school where of low-income students are more likely to have first-year
5th-grade students learn more than 4th-grade students, we principals and less likely to have principals who have been
would expect a good principal to make more changes to the at the school at least six years than those serving a less-dis-
4th-grade teaching staff. advantaged population. Sorting schools by initial achieve-
The results of this analysis confirm that the relationship ment rather than poverty level produces even larger differ-
between higher teacher turnover and lower average value- ences (see Figure 1). The proportion of principals in their
added in a given grade is stronger as principal quality rises. first year leading a school is roughly 40 percent higher in
This pattern of results is consistent with the theory that man- schools in the bottom quartile of average prior achieve-
agement of teacher quality is an important pathway through ment than in schools in the top quartile; the proportion of
Percent
25 23
cipal at another school in the same district, becoming a prin-
20
cipal in another district, moving into a central office position, 16
or exiting the public schools entirely. We divide principals 15
into four equal-sized groups based on estimates of their effec- 10
tiveness using the first of the three methods described above.
We also limit the data to include only principals with fewer 5
than 25 years of total experience in order to minimize com- 0
plications introduced by the decision to retire. Principal new Principal with
Our results confirm that the least-effective principals to school 6+ years in school
are least likely to remain in their current position and most
Schools with low achievement
likely to leave the public schools entirely. With the exception
Schools with high achievement
of the schools with the lowest poverty level, however, there
is not a consistent relationship between the likelihood of Note: Schools with low achievement are those in the bottom quartile
of Texas schools in terms of the prior math test scores of their stu-
remaining on as principal and principal quality (see Figure dents; schools with high achievement are those in the top quartile.
2). In high-poverty schools, for example, principals in the SOURCE: Authors’ calculations based on Texas Education Agency data
middle two quartiles of effectiveness are substantially more
likely to remain than those in the bottom quarter. The most
effective principals are more likely to remain in the same
position than those in the bottom quartile, but are consider- low-performing principals move to principal positions at
ably more likely to move on than those in the middle of the other schools. This trend is particularly striking in high-pov-
quality distribution. erty schools, where more than 12 percent of poor performers
Another result emerging from this analysis that is trou- annually make such a move. In contrast, less than 7 percent
bling from a policy perspective is the frequency with which of the poorest performers in more-affluent schools become
principals at other schools. This may reflect the
fact that it is challenging in high-poverty schools
to separate the effects of school circumstances
from the quality of the principal, leading district
administrators to give principals from high-pov-
erty schools a chance at a different school.
The simple conclusion, nonetheless, is that the
operation of the principal labor market does not
appear to screen out the least-effective principals.
Instead, they frequently move to different schools,
perhaps reflecting the bargain necessary to move
out an ineffective leader in a public-sector orga-
nization. Potentially, this is where the superinten-
dent enters the picture. Making good decisions on
the retention and assignment of principals may be
among the distinguishing characteristics of suc-
A principal in the top 16 percent of the quality distribution will produce annual cessful superintendents, a possibility that warrants
student gains that are 0.05 percent higher. additional study.
68 ED U C A T I O N N E XT / W I N T E R 2 0 1 3 educationnext.org
research
PRINCIPALS BRANCH, HANUSHEK, & RIVKIN