The scouts already priced it in: a draft model whose finding is "nothing"

Every June, analysts publish college-stats models that claim to out-draft NBA front offices. This study asks the question those models usually skip: given where a player was actually picked, does his college production tell you anything more about whether he will make it? The draft pick is not a control variable to brush aside. It is the scouting industry's consensus forecast, assembled from workouts, interviews, medicals, and thousands of scout-hours. Beating it is the bar.

The design is built to make the answer trustworthy rather than flattering. 567 drafted college players (2011–2022) from Barttorvik's advanced-stats archive, joined to NBA outcomes by player ID, with the study's one name join gated at 98% and every historical mismatch hand-audited. The outcome is concrete: a real rotation (2,000+ NBA minutes within three seasons). And the holdout is by era (train on the 2011–2018 classes, test on 2019–2022), because a random split would let the model peek at the era it claims to predict, which is exactly how draft models flatter themselves.

The result: a model using only the pick predicts rotation outcomes at 0.827 AUC out of sample. Add fifteen college box-score features (scoring, rebounding, usage, stocks, age, height, the works) and the test AUC moves to 0.827. The college numbers add +0.000. In-sample they help (0.844 → 0.861), which is precisely the trap: a random-split evaluation would have reported that in-sample flattery as skill. Out of era, the scouts' consensus already contains everything the box score knows.

A negative result is only useful if it is stated as one, so this study promotes it to the headline instead of burying it: public college production, on its own, is not an edge over the pick. The honest byproduct, though, is genuinely useful, because modeling P(rotation) as a function of the pick produces the empirical pick-value curve every trade conversation needs.

Two readings of the curve do real work in front-office arguments. First, its steepness at the top says the difference between pick 3 and pick 12 is enormous. Consensus is informative, which is exactly why beating it is hard. Second, the coin-flip crossing near the back of the first round says late-first-round certainty is an illusion. A team trading up at pick 27 "because our model loves him" is paying a premium for a coin toss, unless its information is genuinely private.

That is the study's actual thesis, and it is a decision-making principle rather than a model: an edge has to come from information the consensus does not already hold (medicals, workouts, intel, or data nobody else has). A model built from public inputs and evaluated the honest way shows you the ceiling of public information, and knowing that ceiling is worth more to a front office than another flattering backtest. The same discipline as the rest of the family applies (dual R/Python implementation reconciled to ~1e-13, with the era holdout wired into the gates), because a negative result you cannot trust is worth nothing at all.

Method, code, and verification

The full technical write-up (data provenance, model specification, validation gates, and stated limitations) is the README. The analysis is implemented independently in R and Python and reconciled to numeric tolerance; run_checks.sh replays every gate.