11-28-2022, 03:41 PM
(11-28-2022, 03:27 PM)Nepa Wrote: I would like to see PFF's grading rubric. Do they only count things like pressures and sacks and tackles for loss and batted passes? Do they ignore a nose tackle occupying two offensive lineman so that others can get pressures and sacks and tackles for loss and batted passes?
This is just an anecdote, so take it with a grain of salt. I know a guy who is familiar with how they grade. He's an offensive coordinator for a school over in Georgia, so he has some level of football background. His personal takeaway was that it was all a joke and shouldn't be taken very seriously. You are given a spreadsheet and work along with another analyst to watch the film and grade players. You are tasked with trying to figure out what their assignment was and whether or not you think they did it well. If you don't know their assignment, you just give them a zero for a neutral grade. If you and the other analyst are more than 0.5 apart from each other, you bring in a senior analyst to make a final decision for you.
His description was that the analysts are primarily college students and you don't get any training on film analysis beforehand. I'll post some quotes from him so it is available verbatim.
Quote:[color=var(--darkreader-inline-color)]PFF graders are casual fans (or less, some Math-y types just looking to get into sports analytics and get a resume, some college kids looking for beer money, I guess now some Indians looking for some coin) with a grading rubric. basically its two guys grade it and if they're apart by more than .5 (so you know they scale on -2 to +2 on .5 increments, if someone gives a -1 and other guy gives a +1 for example) a third guy grades it and then if they're still apart they bring in some "manager" type to give a definitive answer. anytime they don't really know what they're doing/if they did it correctly or incorrectly they just give them a 0. they bucket the coverages into just 0/1/2/3/4/6 to be able to grade them.[/color]
Another guy I know actually has seen the rubric, but said he was a little skeptical if they actually follow it because it is intense. He was a college coach at a smaller school in Texas and said it was a lot of information for him even to do, let alone an unskilled analyst. Sounds like the rubric is intense, but the process is much less so, especially since grades are released pretty damn quick.
