Thursday, February 18, 2016

Getting What You Pay For


Trident Technical College factors faculty grading into faculty evaluations.  Commenters to the IHE story predictably -- and rightly -- raised the specter of grade inflation, assuming that instructors would scramble to meet the grade distribution they need to get the raises they want.

A few thoughts.

First, I try not to be terribly dogmatic about too many things.  Good teaching can take many different forms, including some that I would never try myself.  Subject areas that I would imagine to be dull can be made exciting.  I’m even willing to allow the possibility that a Yankees fan could otherwise be a good person.  But I have a deep-seated aversion -- almost a theological objection -- to evaluating faculty based on the grades they give.  It offends me.  

That said, even firmly held dogma sometimes have exceptions.  When there’s evidence that grading is based on illegitimate considerations -- monetary or sexual interest, say -- then the basis for deference is eliminated.  I would think that most fair-minded people wouldn’t have a problem with those exceptions.

The trickier case is when the grading is so wildly out of keeping with accepted norms that it looks abusive.  This is the professor whose bell curve centers on a “D,” time after time.  That professor may be basing the grades entirely on academic considerations, but applying standards so idiosyncratically as to call the integrity of the course into question.  Cases like those pit ethical standards against each other: faculty academic judgments should be given deep deference, but students shouldn’t be punished for getting Professor Beelzebub, either.  It’s fair to expect some reasonable consistency across sections of the same course.  

At its core, though, the issue is much easier to solve than is often assumed.  

In high-enrollment classes, over time, sample sizes get big enough that random variations in student quality across sections cancel each other out.  “Norming” workshops for faculty are great first steps to ensuring consistency.  I’ve seen English departments do it, though I don’t think it’s unique to them.  Give everyone a few sample papers and have them assign grades; then discuss, as a group, why it got the grades it did.  If someone is applying completely different standards than everyone else -- even if with the best of intentions -- it will come to the surface, and could occasion a really useful departmental conversation about expectations.

But even norming still leaves in place a basic conflict of interest: the same person who is teaching is assigning the grades.  

What if professors traded papers?

To do it well, I could imagine a common assignment across every section of Intro to Stuff.  If the department is big enough, professors could do a group swap along the lines of Secret Santa, so nobody knows who is grading her class.  That should take some awkwardness out of it.  Professors would know that the assignment will be graded by someone else.  Ideally, they’d tell the students that, so the psychological dynamic between professor and student is simplified.  It’s you and me against the judge.  Students would get the relative safety of having at least one assignment graded by someone else, thereby reducing the impact of any one idiosyncratic grader.  And professors who were way out of line with departments would find out before it became an employment issue.  

Alternately, if that’s too cumbersome but a college still insists on evaluating faculty by looking at grading, the conflict of interest could be mitigated by looking at student performance in subsequent courses in the discipline.  If everyone who took Prof. X  for Pre-Calc failed Calc, but everyone else’s students passed Calc at high rates, well, the question seems reasonable.  

Trident is basing evaluations on an uncorrected conflict of interest.  The absolute best result it can hope for is harmlessness.  If you insist on using grades to evaluate faculty -- a huge “if,” with the above exceptions -- you can at least do it right.  This isn’t right.