Comparing the 2010-11 Flyers VUKOTA Projections With Results

In August and September, everyone in the hockey world likes their team's chances for the upcoming season. This is the year a player breaks out, or this player will rebound from a down season, or that player will be great for one more season. Entering camp, everybody is an optimist since you never know what's going to happen.

But that doesn't mean there isn't a way to predict what's going to happen, as baseball's PECOTA system proves to us. So for the past two seasons, Hockey Prospectus has released a projection system called VUKOTA as their answer to Baseball Prospectus' PECOTA system. Here at Broad Street Hockey, we've looked at these for each of the last two seasons, checking in along the way.

After the 2009-10 season, we concluded that the projections seemed accurate, but the results were outliers after looking at each individual player's past. So how about this year?

All tables are sortable by column.

On the left are the projections for games played (GP), goals (G), points (Pts), and points per 82 games (Pts/82). To the right are the actual results.

Just like last year, we see that the biggest flaw in VUKOTA is their method of predicting the number of games each player will miss. Once again, the Flyers were relatively healthy (nine of the team's eleven project-able players hit 75 games), so VUKOTA's projecting poor health was a problem.

But the system did have some pretty accurate predictions, specifically the predictions for van Riemsdyk, Carter, and Briere. It came close with Betts, Hartnell, and Powe, while it missed Giroux, Leino, Richards, Carcillo, and Shelley. Not exactly great results, but excuses can be made - including the small sample sizes of Leino's career to that point and Richards' injury - so let's try and identify the problem.

As we did prior to the season, let's compare the projections to the players' point per game rates of the last three years:

What do we see? Briere had his best year of the last three seasons, which wasn't predicted. Carter repeated last year's performance rather than improve as predicted, Giroux went from being the fourth highest point per game player to the highest, Richards didn't rebound like he was expected, and Leino played like his 13-game debut rather than what got him thrown out of Detroit.

What's this mean? Well, there are obviously still flaws. But to say predictions are useless ignores how close VUKOTA gets. The misses came on players who are on the fourth line (Carcillo and Shelley), had breakout years (Giroux and Leino), or have no heart played through a wrist injury all season (Richards). Maybe that's too many excuses to make for a projection system, but it wasn't bad. Consider:

Team Predictions With Results

1. Not a single Flyer was expected to breach the point-per-game ratio this year. Correct. Claude Giroux came the closest, with 0.93. HIT
   
   
2. Only Carter and Richards were expected to hit 25 goals, though Briere would hit 28 over a full season. Predicting three 25 goal scorers... you get three 25 goal scorers. But Richards only hit 23 while Giroux hit 25. Hartnell hit 24, one more than predicted. HIT
   
   
3. Only three players (Betts, Laperriere, and Shelley) were expected to see their points per game ratio decrease from last year. Betts and Shelley did decrease, but so did Powe and Carcillo. Predicting fourth line production has proven to be difficult for VUKOTA, and there's really no good explanation for predicting Powe to score 0.28 points per game. CLOSE
   
   
4. Claude Giroux was expected to have a pretty big breakout year, going to 0.735 points per game, up from 0.573. He did in fact have a pretty big breakout year, but it was even bigger than predicted. MISS
   
   
5. This group - including Zherdev - was expected to score 207.1 goals. Even without Laliberte and Laperriere's 8.9 goals, the group combined to score 216. CLOSE
   
   
6. As a group, the Flyers could expect their defensemen to chip in 38.7 goals. Here's a big miss. The Flyers defensemen only contributed 22 goals, with Coburn and Carle accounting for half (9) of the difference in performance. Timonen and Pronger missed the mark by a combined six goals, and there's the majority of your problem. MISS
   
   
7. GVT saw the Flyers scoring the same amount of goals as last year, while VUKOTA saw the Flyers scoring 254. But normalizing for the league numbers, VUKOTA agrees with GVT, predicting 237 goals. Without the normalization, VUKOTA would have nailed it - actual 256 goals for. But it did normalize, so... MISS
   

So there you have it. VUKOTA still has a lot of work to do - particularly in predicting games played and on defense - but it absolutely has predictive value. How much is a legitimate debate, but the results are there.