Many modern faculty rating systems rely on the evaluation of students and of a handful of observations. This article examines whether or not this system measures what we really want to gauge