Tuesday, September 27, 2022

CURRENT ACTUAL RPI RATINGS FOR GAMES THROUGH SEPTEMBER 25

Use the following link for access to an Excel workbook with actual RPI ratings and ranks and other data for teams based on games through September 25, 2022: 2022 RPI Report 9.25.22.  On the left of the RPI Report sheet, there are five color coded columns.  These columns are based on the seasons from 2007 to the present (excluding the 2020 Covid-constrained season).  They show the rank ranges as of this stage of the season from which #1 through #4 seeds have come.  They also show the at large bubble range and that teams ranked #10 or better as of this stage of the season always have gotten at large selections.

For understanding the limitations of mathematical rating systems, it is worth paying attention to the color coded columns as they evolve through the course of the season.  For this week, these are the rank ranges for seeds and at large selections:

#1 seeds:  ranked #28 or better

#2 seeds:  ranked #50 or better

#3 seeds:  ranked #85 or better

#4 seeds:  ranked #85 or better

At large selections:

Assured: ranked #10 or better

Bubble:  ranked #11 through #148

When the regular season, including conference tournaments, is over, here are the ranges:

#1 seeds:  ranked #7 or better

#2 seeds:  ranked #14 or better

#3 seeds:  ranked #23 or better

#4 seeds:  ranked #26 or better

At large selections:

Assured: ranked #30 or better

Bubble:   ranked#31 through #57

Week by week, the ranges will shrink from the current ones to the final ones.  As you can see, at this week in the season, the RPI is not close to where it needs to be to be useful.  This is a good reminder that the RPI is intended to be used for actual decisions only at once point in the season: the time when the Committee makes its at large selections and seeds.

The end-of-season ranges also are an indicator of how the Committee sees the accuracy of the RPI.

Seed Range.  The range from which the Committee has picked seeds extends to rank #26.  Since there are 16 seeds, this suggests that the Committee thinks (consciously or not) that in that rank range, the RPI can be up to 10 positions off in where it places teams.

At Large Selection Range.  Teams ranked #30 or better always have gotten at large selections.  The range from which the Committee has made the remaining at large picks extends to rank #57.  The Committee picks a total of 33 at large teams.  Among the top 33 teams, there is a reasonable chance there will be 7 to 9 automatic qualifiers (the Power 5 conference champions and the American, Big East, Ivy, and West Coast conference champions).  This means the Committee will be trying to identify roughly the 40 to 42 best performing teams as the ones to get the 33 at large positions, given that about 7 to 9 of them will be automatic qualifiers.  This suggests a number of things:

1.  In the #30 or better rank range, the Committee thinks (consciously or not) that the RPI can be only up to 10 positions off in where it places teams.  Put differently, if a team is ranked #30 by the RPI, it must be at least among the top 40 best performing teams.

2.  In the #31 plus a little rank range, the Committee thinks (consciously or not) that the RPI can be off by 10 or more positions.

3.  As the ranks get poorer, the Committee thinks (consciously or not) that the RPI can be off by increasing numbers of positions, including by as many as about 17 positions when it gets to the #57 ranked team.

4.  Putting 2 and 3 together, in the #31 to #57 rank range, roughly speaking, an RPI rank difference of about 26 positions may not be sufficient to establish that the better ranked team has been the better performing team.

NOTE:  The rank ranges are based on years during which tie games went to overtime, whereas starting this year there will be no overtime games except during conference tournaments.  I do not believe the rule change will lead to a change in the rank ranges, but it could. 

SIMULATED END OF SEASON ARPI RANKS USING ACTUAL RESULTS OF GAMES PLAYED THROUGH SEPTEMBER 25 AND SIMULATED RESULTS FOR FUTURE GAMES

Below are simulated end-of-season Adjusted RPI ranks using the actual results of games played through Sunday, September 25 and simulated results of games not yet played.  The simulated results of games not yet played are based on the current actual ARPI ratings of the opposing teams as adjusted for home field advantage.

I have made two changes in the calculation rules starting this week:

1.  I have determined that with the change this year to no overtimes, there has been a slight change in the value of home field.  Previously, home field advantage was worth 0.0150 in relation to teams’ comparitive ARPI ratings.  I think of this as the home team playing as though its rating were 0.0075 better and the away team as though its rating were 0.0075 poorer.  With the change to no overtimes, home field advantage has increased slightly to 0.0156.  (These values are based on a study of all games played since 2007 for the previous value and since 2010 for the new value.)

2.  Previously, if the location-adjusted rating difference between opponents was 0.0133 or less, the simulated result for the game was a tie.  This was because at that rating difference level, the chance of the better rated team winning was less than 50%, so that the better rated team was more likely to lose or tie than to win.  Simulating the result as a tie is a compromise to address this problem.  With the change to no overtimes, the difference at which the simulated result is a tie is 0.0266.  (These values are based on a study of all games played since 2007 for the previous value and since 2010 for the new value.  It is a coincidence that the new value is exactly twice the old value.)

Here are the simulated end-of-season ranks: 


 

EVALUATION OF TEAMS FOR NCAA TOURNAMENT PURPOSES BASED ON ACTUAL RESULTS OF GAMES THROUGH SEPTEMBER 25 AND SIMULATED RESULTS OF FUTURE GAMES

Below are tables showing simulated seed and at large selection candidate groups based on the actual results of games played through September 25 and simulated results of games not yet played.  There also is a table showing simulated conference champion automatic qualifiers.  For the candidate groups, each table shows how many historic patterns each team meets indicating that the team will or will not get a positive decision from the Committee.

For the at large selection table, although all at large selections historically have come from teams ranked #57 or better, I have included teams ranked #65 or better.

Reminder:  From among the teams that are not automatic qualifiers, the Committee will pick 33 teams as at large participants.


















Wednesday, September 21, 2022

CURRENT ACTUAL RPI RATINGS FOR GAMES THROUGH 9.18.22

From now until the end of the season, I will be doing three articles each week.

1,  The first article will be team actual RPI ratings and ranks and other information, to date.

2.  The second article will be simulated end-of-season ARPI rankings based on the actual results of games played to date and simulated results of games not yet played.  The simulated results will be based on the actual ARPI ratings of teams, to date.

3.  The third article will be simulated NCAA Tournament brackets based on the actual results of games played to date and simulated results of games not yet played.

Over the course of the season, all of these should come closer and closer to where they actually will end up.

Here is a link to this week’s workbook with actual RPI ratings and ranks, as well as other information, based on games played through September 18, 2022: 2022 RPI Report 9.18.22.

Two notes about the workbook:

1.  On the RPI Report Source page, which has team RPI data, I have included two columns on the far right, that I did not include in previous years.  Previously, on the right, I had two columns: Strength of Schedule and Strength of Schedule Rank.  I still have those columns.  I have added, next to them:

 a.  Opponents Average Rank.  The Strength of Schedule Rank column is based on ratings from the strength of schedule portion of the RPI formula.  This is not the same, however, as Opponents Average Rank and in fact can be quite different due to the structure of the RPI.  The Opponents Average Rank column gives a better picture of how strong a schedule is as compared to the Strength of Schedule Rank.

b.  Strength of Schedule Contributor Rank.  This shows how a team ranks as a strength of schedule contributor to its opponents, based on how the RPI calculates strength of schedule.  If you compare it to the RPI Rank column, you can see that in many cases a team rank is quite different from its rank as a strength of schedule contributor.

 Also, some notes about the accuracy of my numbers:  Weekly, once the NCAA has published its ratings at the RPI Archive (a different source than the rankings it publishes at NCAA.com), I compare my ratings to theirs.  If my numbers differ from theirs, I go through a checking process to find out why there are differences.  The differences can come from data errors or from programming errors.  If the errors are mine, I make corrections and re-run my numbers to be sure they match the NCAA numbers.  If the errors are theirs, I inform them of the errors and hope they will make corrections.  (I also work cooperatively with Chris Henderson to be sure his College Women’s Soccer Schedule data match mine and the NCAA’s.)

The NCAA current numbers have some errors related to penalty adjustments.  There are two tiers of penalty adjustments: the higher ones apply to teams with ties or losses against teams in the RPI bottom 40 of the rankings and the lower ones apply to teams with ties or losses against teams in the RPI next to bottom 40.  This means that when there are new teams competing in Division 1, the penalty programming must change.  For example, this year, with the number of D1 teams increasing to 348, the programming had to change so that the penalty tiers are teams ranked 269-308 and 309-348.  As has happened a number of times in the past, the NCAA has forgotten to change its penalty tiers.  Thus some teams are receiving penalties from the NCAA when they should not be.  I have let them know of this error and hope they will make a correction.

Apart from the penalty tier problem, my numbers match the NCAA numbers.

SIMULATED END OF SEASON ARPI RANKS USING ACTUAL RESULTS THROUGH SEPTEMBER 18 AND SIMULATED RESULTS FOR FUTURE GAMES

Starting this week, when I simulate the results of future games I will use current actual ARPIs as adjusted for home field advantage (rather than using pre-season assigned ARPIs as adjusted).

As each week passes, since more and more actual results will be part of the data, the simulated end-of-season ranks should come closer and closer to where they ultimately will end up.

In addition to other cautions about the simulations, there are three reservations I want to emphasize:

1.  The value of home field I use is 0.0148 (in relation to RPI ratings), which comes from a statistical analysis of all game results since 2007.  It is based, however, on games that included overtime games decided by golden goals.  With the change to no overtimes, it is possible this value will change.  I will be doing a study of this, but have not done it yet.

2.   I designate as ties all games where the location-adjusted rating difference between opponents is 0.0133 or less.  This likewise comes from a statistical analysis of all game results since 2007, including overtime games decided by golden goals.  With the change to no overtimes, this value will change but I have not yet done a study to determine the new value.

3.  For every game where the rating difference between opponents is greater than the tie threshold, I designate the game as a win by the better rated team.  That is the only practical way to do it.  In real life, however, the better rated team over a series of games will not win them all.  As a result, teams at the high end of my ratings show better records than they are likely actually to have and teams at the low end show poorer records.

With all of that in mind, here are the simulated end-of-season ranks using the actual results of games played through September 18 and simulated results of games not yet played: 

Team for Bracket Formation

ARPI Rank

AlabamaU

1

UCLA

2

Rutgers

3

NotreDame

4

VirginiaU

5

NorthCarolinaU

6

Harvard

7

StLouis

8

ArizonaState

9

Duke

10

Clemson

11

SouthCarolinaU

12

OhioState

13

PortlandU

14

Georgetown

15

BYU

16

ArkansasU

17

MississippiU

18

TCU

19

NCState

20

Xavier

21

PennState

22

WashingtonState

23

LSU

24

NorthwesternU

25

SouthAlabama

26

UtahValley

27

Pepperdine

28

Lamar

29

GrandCanyon

30

WisconsinU

31

OklahomaState

32

TexasA&M

33

UCF

34

VCU

35

Buffalo

36

CalStateFullerton

37

Pittsburgh

38

SouthDakotaState

39

FloridaState

40

WakeForest

41

Brown

42

Memphis

43

UAB

44

JamesMadison

45

Drexel

46

SMU

47

UtahU

48

Northeastern

49

MississippiState

50

Fairfield

51

EasternKentucky

52

GeorgiaU

53

BoiseState

54

WashingtonU

55

MichiganState

56

CaliforniaU

57

ConnecticutU

58

SanFrancisco

59

Stanford

60

IUPUI

61

KansasU

62

Quinnipiac

63

Auburn

64

Dayton

65

Creighton

66

FloridaAtlantic

67

Campbell

68

LoyolaChicago

69

Milwaukee

70

EastCarolina

71

Chattanooga

72

OregonU

73

SanDiegoState

74

TexasU

75

LaSalle

76

NorthwesternState

77

Samford

78

UMassLowell

79

SouthernMississippi

80

UNCGreensboro

81

WrightState

82

Towson

83

Monmouth

84

Princeton

85

ArizonaU

86

Radford

87

Columbia

88

CaliforniaBaptist

89

Wofford

90

Liberty

91

MiamiFL

92

SELouisiana

93

Louisville

94

William&Mary

95

BowlingGreen

96

TexasState

97

TennesseeU

98

OklahomaU

99

MontanaU

100

NorthAlabama

101

SIUEdwardsville

102

VirginiaTech

103

KentuckyU

104

NewMexicoState

105

MissouriState

106

MassachusettsU

107

Purdue

108

NebraskaU

109

MaineU

110

SouthernCalifornia

111

SantaClara

112

UtahState

113

MountStMary

114

TennesseeTech

115

Dartmouth

116

WestVirginiaU

117

HawaiiU

118

Denver

119

Yale

120

LoyolaMD

121

Duquesne

122

LoyolaMarymount

123

WesternKentucky

124

Lipscomb

125

Davidson

126

OhioU

127

TexasTech

128

Hartford

129

Butler

130

AppalachianState

131

Drake

132

GeorgiaState

133

Tarleton

134

MissouriU

135

OregonState

136

Gonzaga

137

Oakland

138

Army

139

Elon

140

Vanderbilt

141

Hofstra

142

KennesawState

143

Marist

144

ColoradoU

145

Cincinnati

146

NorthDakotaState

147

AirForce

148

Merrimack

149

UNCWilmington

150

MiamiOH

151

Tulsa

152

Seattle

153

NorthTexas

154

IllinoisU

155

LongBeachState

156

IndianaU

157

NJIT

158

Syracuse

159

CentralConnecticut

160

SetonHall

161

Binghamton

162

NorthernColorado

163

StMarys

164

Toledo

165

NewMexicoU

166

Niagara

167

MichiganU

168

ClevelandState

169

TexasCommerce

170

GreenBay

171

MarylandU

172

Mercer

173

RhodeIslandU

174

Grambling

175

SouthernUtah

176

RobertMorris

177

ColoradoCollege

178

IdahoU

179

UCIrvine

180

BostonCollege

181

WesternIllinois

182

LouisianaMonroe

183

UCDavis

184

StThomas

185

Navy

186

Marquette

187

Belmont

188

GeorgiaSouthern

189

WesternCarolina

190

OldDominion

191

GeorgeMason

192

Lafayette

193

Rice

194

Longwood

195

SIUCarbondale

196

Baylor

197

Bucknell

198

SanDiegoU

199

UtahTech

200

Houston

201

FloridaGulfCoast

202

UMKC

203

Canisius

204

NorthernIllinois

205

EastTennesseeState

206

SoutheastMissouriState

207

CollegeofCharleston

208

IPFW

209

PennsylvaniaU

210

CalStateNorthridge

211

GeorgeWashington

212

GardnerWebb

213

KansasState

214

EasternWashington

215

StJohns

216

UCRiverside

217

Providence

218

IowaState

219

ColoradoState

220

Bellarmine

221

BostonU

222

OralRoberts

223

Evansville

224

CentralArkansas

225

Temple

226

VermontU

227

WesternMichigan

228

UMBC

229

Albany

230

American

231

JacksonvilleU

232

TexasCorpusChristi

233

HighPoint

234

JacksonState

235

FloridaU

236

ArkansasState

237

StFrancis

238

SouthFlorida

239

MinnesotaU

240

Charlotte

241

Detroit

242

UNLV

243

USCUpstate

244

Troy

245

IowaU

246

TexasRGV

247

McNeeseState

248

TennesseeMartin

249

KentState

250

LouisianaTech

251

NorthFlorida

252

MurrayState

253

UCSanDiego

254

Iona

255

SouthernIndiana

256

IllinoisChicago

257

WyomingU

258

StephenFAustin

259

BallState

260

DePaul

261

Bryant

262

UTSA

263

LouisianaLafayette

264

CalPoly

265

StBonaventure

266

Furman

267

FairleighDickinson

268

Lehigh

269

Cornell

270

StonyBrook

271

SacredHeart

272

UALR

273

AbileneChristian

274

StFrancisBrooklyn

275

UNCAsheville

276

Morehead

277

Pacific

278

NewHampshireU

279

IdahoState

280

Fordham

281

StJosephs

282

Citadel

283

Marshall

284

CoastalCarolina

285

NorthernKentucky

286

SanJoseState

287

AlcornState

288

NichollsState

289

MiddleTennessee

290

FIU

291

Akron

292

Richmond

293

Winthrop

294

StPeters

295

UTEP

296

JacksonvilleState

297

NorthDakotaU

298

EasternIllinois

299

AlabamaA&M

300

Rider

301

EasternMichigan

302

CalStateBakersfield

303

HoustonBaptist

304

AustinPeay

305

Stonehill

306

SouthernU

307

Hampton

308

UNOmaha

309

Manhattan

310

HolyCross

311

YoungstownState

312

IllinoisState

313

WeberState

314

ArkansasPineBluff

315

SamHoustonState

316

ChicagoState

317

IncarnateWord

318

DelawareU

319

UCSantaBarbara

320

NorthernArizona

321

NevadaU

322

Valparaiso

323

Stetson

324

Siena

325

FresnoState

326

CharlestonSouthern

327

CentralMichigan

328

SacramentoState

329

Presbyterian

330

Lindenwood

331

MississippiValley

332

PortlandState

333

Queens

334

Wagner

335

Villanova

336

Colgate

337

SouthDakotaU

338

VMI

339

Howard

340

IndianaState

341

UNI

342

LongIsland

343

TexasSouthern

344

DelawareState

345

PrairieViewA&M

346

AlabamaState

347

SouthCarolinaState

348