When the Draft Pundits Are Right, and the NFL Teams Wrong

It’s every NFL fan’s nightmare. After months of anticipation, your team’s first-round pick in the NFL Draft (the 2022 edition starts tonight) is deemed a “reach” – a player picked well before the experts thought he should be selected.

From the draft guru Mel Kiper Jr. On ESPN to the local bloggers on Twitter, everyone seems to think your team blew it. There were at least a dozen better players on the board, they say. The player may have even been around in the next round, they say.

But are they right? It turns out they might.

In this case, it is worth taking the pundits and the blowhards seriously, based on an analysis of ESPN predraft grades over nearly 20 years.

The results have not been great for teams using a top draft pick on a reach – defined here as a nonquarterback whose ESPN ranks at least 10 spots below the team’s draft slot in the top half of the first round. Overall, these reaches have yielded below-average picks in 17 of 19 cases – or 89 percent of the time – since 2005.

The draft gurus do not always have all the answers, of course. Other analysis has found that their post-draft grades are essentially worthless. Many of the players consider the experts “steals” – the highly regarded players who fall unexpectedly to a seemingly lucky team – not what they are cracked up to be. And teams do a better job of finding hidden gems later in the draft. As a result, the teams will eventually beat the analysts over the course of the draft, if only modestly. If the analysts don’t love your team’s draft, it might very well still turn out OK – or even great.

But despite the superior resources – and despite being paid the big bucks to get it right – teams often err when they defy media experts in the draft’s highest-stakes moment: the top half of the first round.

The stakes are so high because the draft is not quite crapshoot that it can sometimes seem. Despite the occasional Tom Brady unearthed in the mid-to-late rounds, a high first-round pick is much more likely to end up as a good football player than later selections. Even when teams are convinced they have found a diamond in the rough, they could probably trade back to a later selection, and receive additional draft picks while acquiring the same player.

For fans, a first-round reach is so noteworthy because it can spark a media firestorm. Seeing a “steal” may not turn out to be a steal, but the pundits and your team appear to be in agreement. There will be no controversy; There probably won’t be much second-guessing if the pick doesn’t pan out.

Yet teams rarely beat the conventional wisdom when they reach for a low-ranked player, despite all the incentives to select only when a team is absolutely sure.

The experts have a bad record in a seemingly similar case: when several teams pass on a player talking up analysts in the days and weeks ahead of the draft. These so-called steals can seem like a tremendous value for a lucky team that lands on them. Your team may be praised on talk radio. But these picks don’t tend to turn out unusually well. On average, the steals offer no greater value to teams than one would expect for their draft slot.

Why do the experts offer value over the teams in some cases but not others? Timo Riske, a data scientist for Pro Football Focus who reached similar conclusions in an analysis of drafts since 2013, observed that “when a player is a steal, that means several teams – maybe even all 32 teams – passed on him,” while A reach could mean that only a single team liked a player more than the experts.

“Betting against the NFL’s overall assessment of players is essentially saying your evaluation of a player is better than everyone else,” said Ben Robinson, a founder of a website that analyzes the draft. “It’s not sustainable.”

The analysis relies on the Pro Football Reference’s approximate Value Metric, an imperfect but useful measure of a player’s contribution to a team’s success. For the remainder of this article, a reach or a steal is a player selected in a slot with an expected approximate value that is five points Higher or lower than one might guess from ESPN’s ranking. This clunky definition helps account for greater differentiation of players at the top of the draft: Selecting ESPN’s 10th-best player with the first overall pick is expected to reach this measure, but a player may be ranked 170th or lower by ESPN. To be considered a reach with the 100th pick.

The analysis also excludes quarterbacks, a position that poses unusual challenges for draft analysis. On the one hand, many teams will pass on a highly regarded quarterback if they already have what they see as a good quarterback. On the other hand, teams rank quarterbacks with the position’s unusually high value in mind while many pundit draft boards do not.

A player projected as just a league-average starting quarterback may be far more valuable than a player projected as, say, an above-average cornerback. But the cornerback could be ranked higher on a draft board. And a team that “reacts” to a quarterback could be vindicated by the data, even if the player doesn’t pan out, simply because of the position’s high value.

One example is Daniel Jones, who was ranked 59th by ESPN before he was selected by the Giants with the sixth overall pick in 2019. By this measure, it is the second-biggest reach in the top half of the first round since 2005. The Pundits Declare the selection a “mistake,” and they may be right. Many analysts have already labeled him a bust, as he has posted below-average numbers every year he has been in the league. But he’s a starting quarterback; By the approximate value measure and others, he is on track to post good enough value for the selection.

As the draft goes on, the outside analysis slowly loses its value. As soon as the second round – and the remainder of the draft – you can largely expect pundits to be of little service. The steals are still not steals, but the purported reaches are not reacting anymore: A player taken 50th overall but ranked 100th is likely to be as valuable as he should be given his selection. That doesn’t mean the teams are brilliant; The draft really does become more like a crapshoot by the time you get into the middle rounds. But you don’t need to pay too much attention to your team’s critics – or praisers.

At this late stage, the best resources of the teams may give them a better chance of being recognized by public analysts. And teams may select players with a specific idea of ​​how they might capitalize on a player’s strengths and minimize weaknesses.

The teams also have control playing time. A third-round reach is likely to be a third-rounder given the ample playing time; A seventh-round steal might be treated like a fringe player, even if the analysts were right about that player’s upside.

In the most extreme cases, a possible win for the experts might never prove itself. Imagine if Brady had finally gone undrafted – he went for 199th out of 254 picks – even though the experts rated him as a middle-round pick, and then imagine he never played a game.

By the data, the experts would have seemed wrong to rank him so high.


Josh Katz contributed reporting.

Leave a Comment