SMP · measured by title sample games

Sufficient Sample

Context

There are too few games and too many teams. That has been true of college football since there were conferences, and it is more true at sixteen than it was at ten. The only response is to make sure the games that are played all bear on the thing being decided, so that nine games are nine pieces of evidence and not three pieces and six exhibitions.

Problem

A format that decides the title on three or four games has a small sample, however exciting. A format that decides it on nine games where six are dead has a small sample too, and worse television.

Forces

  • Sample pulls against consequence. More games bearing on the title means each game bears less.
  • Sample pulls against structure. A knockout's sample is its depth, and a standings race's sample is its length.
  • Counting is the hard part. The right count is games whose result could have changed who the champion is, counted for the champion.

Solution

Count, for the eventual champion, the number of conference games whose outcome bore on the title: games on a cup path, games that set pool rank or standing, the final. Prefer formats where that count approaches nine.

Therefore

Make most of a champion's nine games part of the case for the title.

Measure

The number of the champion's conference games that bore on the title determination, averaged across seasons.

Lore

Taleb's rule for small samples is that you do not get to be confident about the mean until you have seen the tails, and a nine-game season never sees the tails. The conference cannot fix that, but it can refuse to make it worse by deciding the title on three games.

Pulls against EGC Every Game CountsDEF Decisive FinalNPC No Poll, No Committee, No Coin Flip

Seen in

scenariolanguagesimulatedvalue
status-quo+ honors+ honors9
pool-play~ strains~ strains6
two-cups+ honors+ honors9
two-cups-b+ honors+ honors9
four-cups+ honors+ honors9
pools-playoff+ honors+ honors9
mini-playoff+ honors+ honors9
chase+ honors+ honors9
seven-settle+ honors+ honors9
seven-final+ honors+ honors9
seven-semis+ honors+ honors9
eight-final+ honors+ honors9
  • status-quo: honors. All nine count.
  • pool-play: strains. Six, by design; the last three are fixed games.
  • two-cups: honors. Every one of the champion's nine games is a championship game or the super final.
  • four-cups: honors. Every one of the champion's nine games is a cup game or a final.
  • pools-playoff: honors. Six pool games to win a place, plus the playoff.
  • mini-playoff: honors. Four pod games, two rivalry games, three playoff games, if the rivalry games count toward qualifying.
  • chase: honors. All nine in the standings.

See it: status-quopool-playtwo-cupstwo-cups-bfour-cupspools-playoffmini-playoffchaseseven-settleseven-finalseven-semiseight-final