Measuring and Promoting Inter-Rater Agreement of Teacher and Principal Performance Ratings

Topic: 
Teacher/Principal Evaluation
Year of Publication: 
2012
Author: 
Graham, Matthew
Milanowski, Anthony
Miller, Jackson

As states, districts, and schools transition toward more rigorous educator evaluation systems, they are placing additional weight on judgments about educator practice. Because evaluation results are beginning to help inform high-stakes decisions about promotion, retention, tenure, and compensation, it is becoming increasingly important to achieve high inter-rater agreement and inter-rater reliability in observational evaluations. This paper outlines why inter-rater agreement is important, identifies the level to which ratings should agree, and indicates how evidence of agreement can be gathered. It also addresses factors that can affect inter-rater agreement, to include rater training, rater selection, accountability, rubric design and use, and program piloting and redesign.

Format: 
Report or White Paper
Suggested Citation: 
Graham, M.; Milanowski, A.; & Miller, J. (2012). Measuring and promoting inter-rater agreement of teacher and principal performance ratings. Retrieved from http://www.tifcommunity.org
image: Measuring and Promoting Inter-Rater Agreement of Teacher and Principal Performance Ratings