Principal Preparation Programs and Principal Outcomes

Jason A. Grissom, Hajime Mitani, David S. Woo

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Purpose: Concerns about variation in the quality of preservice preparation provided by many university-based principal preparation programs (PPPs) has led to calls to use outcomes of program graduates to hold PPPs accountable. Little research, however, has assessed the degree to which different outcomes for PPP graduates in fact vary systematically by program. Research Methods: Using administrative data from Tennessee, we link approximately a decade’s worth of PPP graduates to their schools, licensure examination scores, and multiple measures of job performance in their first 3 years as principals, including supervisors’ practice ratings on the state evaluation system, teacher and assistant principal ratings of school leadership on a statewide survey, and measures of student achievement growth. We use which PPP a principal completed to predict these outcomes using a regression approach with different sets of covariates. Findings: Although we are able to associate PPPs with high and low principal performance, we find that programs’ rankings vary by outcome measure, and we are unable to identify PPPs that perform consistently well or poorly across outcomes. Moreover, we find that Tennessee PPPs vary substantially in the characteristics of the schools into which their principals are hired and that taking these characteristics into account is important in ordering PPPs based on outcomes. In addition, even over a fairly long time frame, some programs produce too few graduates who later become school leaders to allow for reliable estimates. Implications: Although the use of graduates’ outcomes to differentiate PPPs holds promise, the methodological challenges to drawing valid and reliable conclusions about PPPs from graduates’ job outcomes are substantial. Policymakers and researchers may arrive at very different assessments of which PPPs are successful depending on which outcomes are chosen and what modeling approaches are employed.

Original languageEnglish (US)
Pages (from-to)73-115
Number of pages43
JournalEducational Administration Quarterly
Volume55
Issue number1
DOIs
StatePublished - Feb 1 2019

Fingerprint

graduate
school
rating
job performance
assistant
research method
ranking
leadership
leader
regression
examination
university
teacher
evaluation
performance
student

All Science Journal Classification (ASJC) codes

  • Education
  • Public Administration

Cite this

Grissom, Jason A. ; Mitani, Hajime ; Woo, David S. / Principal Preparation Programs and Principal Outcomes. In: Educational Administration Quarterly. 2019 ; Vol. 55, No. 1. pp. 73-115.
@article{b34dab2ac1894d419d7eff1672db4aca,
title = "Principal Preparation Programs and Principal Outcomes",
abstract = "Purpose: Concerns about variation in the quality of preservice preparation provided by many university-based principal preparation programs (PPPs) has led to calls to use outcomes of program graduates to hold PPPs accountable. Little research, however, has assessed the degree to which different outcomes for PPP graduates in fact vary systematically by program. Research Methods: Using administrative data from Tennessee, we link approximately a decade’s worth of PPP graduates to their schools, licensure examination scores, and multiple measures of job performance in their first 3 years as principals, including supervisors’ practice ratings on the state evaluation system, teacher and assistant principal ratings of school leadership on a statewide survey, and measures of student achievement growth. We use which PPP a principal completed to predict these outcomes using a regression approach with different sets of covariates. Findings: Although we are able to associate PPPs with high and low principal performance, we find that programs’ rankings vary by outcome measure, and we are unable to identify PPPs that perform consistently well or poorly across outcomes. Moreover, we find that Tennessee PPPs vary substantially in the characteristics of the schools into which their principals are hired and that taking these characteristics into account is important in ordering PPPs based on outcomes. In addition, even over a fairly long time frame, some programs produce too few graduates who later become school leaders to allow for reliable estimates. Implications: Although the use of graduates’ outcomes to differentiate PPPs holds promise, the methodological challenges to drawing valid and reliable conclusions about PPPs from graduates’ job outcomes are substantial. Policymakers and researchers may arrive at very different assessments of which PPPs are successful depending on which outcomes are chosen and what modeling approaches are employed.",
author = "Grissom, {Jason A.} and Hajime Mitani and Woo, {David S.}",
year = "2019",
month = "2",
day = "1",
doi = "10.1177/0013161X18785865",
language = "English (US)",
volume = "55",
pages = "73--115",
journal = "Educational Administration Quarterly",
issn = "0013-161X",
publisher = "SAGE Publications Inc.",
number = "1",

}

Principal Preparation Programs and Principal Outcomes. / Grissom, Jason A.; Mitani, Hajime; Woo, David S.

In: Educational Administration Quarterly, Vol. 55, No. 1, 01.02.2019, p. 73-115.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Principal Preparation Programs and Principal Outcomes

AU - Grissom, Jason A.

AU - Mitani, Hajime

AU - Woo, David S.

PY - 2019/2/1

Y1 - 2019/2/1

N2 - Purpose: Concerns about variation in the quality of preservice preparation provided by many university-based principal preparation programs (PPPs) has led to calls to use outcomes of program graduates to hold PPPs accountable. Little research, however, has assessed the degree to which different outcomes for PPP graduates in fact vary systematically by program. Research Methods: Using administrative data from Tennessee, we link approximately a decade’s worth of PPP graduates to their schools, licensure examination scores, and multiple measures of job performance in their first 3 years as principals, including supervisors’ practice ratings on the state evaluation system, teacher and assistant principal ratings of school leadership on a statewide survey, and measures of student achievement growth. We use which PPP a principal completed to predict these outcomes using a regression approach with different sets of covariates. Findings: Although we are able to associate PPPs with high and low principal performance, we find that programs’ rankings vary by outcome measure, and we are unable to identify PPPs that perform consistently well or poorly across outcomes. Moreover, we find that Tennessee PPPs vary substantially in the characteristics of the schools into which their principals are hired and that taking these characteristics into account is important in ordering PPPs based on outcomes. In addition, even over a fairly long time frame, some programs produce too few graduates who later become school leaders to allow for reliable estimates. Implications: Although the use of graduates’ outcomes to differentiate PPPs holds promise, the methodological challenges to drawing valid and reliable conclusions about PPPs from graduates’ job outcomes are substantial. Policymakers and researchers may arrive at very different assessments of which PPPs are successful depending on which outcomes are chosen and what modeling approaches are employed.

AB - Purpose: Concerns about variation in the quality of preservice preparation provided by many university-based principal preparation programs (PPPs) has led to calls to use outcomes of program graduates to hold PPPs accountable. Little research, however, has assessed the degree to which different outcomes for PPP graduates in fact vary systematically by program. Research Methods: Using administrative data from Tennessee, we link approximately a decade’s worth of PPP graduates to their schools, licensure examination scores, and multiple measures of job performance in their first 3 years as principals, including supervisors’ practice ratings on the state evaluation system, teacher and assistant principal ratings of school leadership on a statewide survey, and measures of student achievement growth. We use which PPP a principal completed to predict these outcomes using a regression approach with different sets of covariates. Findings: Although we are able to associate PPPs with high and low principal performance, we find that programs’ rankings vary by outcome measure, and we are unable to identify PPPs that perform consistently well or poorly across outcomes. Moreover, we find that Tennessee PPPs vary substantially in the characteristics of the schools into which their principals are hired and that taking these characteristics into account is important in ordering PPPs based on outcomes. In addition, even over a fairly long time frame, some programs produce too few graduates who later become school leaders to allow for reliable estimates. Implications: Although the use of graduates’ outcomes to differentiate PPPs holds promise, the methodological challenges to drawing valid and reliable conclusions about PPPs from graduates’ job outcomes are substantial. Policymakers and researchers may arrive at very different assessments of which PPPs are successful depending on which outcomes are chosen and what modeling approaches are employed.

UR - http://www.scopus.com/inward/record.url?scp=85050268479&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050268479&partnerID=8YFLogxK

U2 - 10.1177/0013161X18785865

DO - 10.1177/0013161X18785865

M3 - Article

AN - SCOPUS:85050268479

VL - 55

SP - 73

EP - 115

JO - Educational Administration Quarterly

JF - Educational Administration Quarterly

SN - 0013-161X

IS - 1

ER -