Predictions Pre-Schmictions
- RonCo
- GB: JL Frontier Division Director
- Posts: 19976
- Joined: Sat Nov 14, 2015 10:48 pm
- Has thanked: 2011 times
- Been thanked: 2976 times
Predictions Pre-Schmictions
Let's Have Fun With the OOTP Pre-season Projections, Shall We?
After seeing folks comment on the in-game predictions, I got to wondering…just how good are these estimates the game comes up with? Looking at the forum, I saw Recte posted this year’s predictions in the Sim #1 thread, and added a couple numbers together to have it dawn on me that maybe the predictions for last year were in the 2036 threads.
That’s right. I mean. You gotta get up pretty early to put one past me.
So, using last year’s data, I grabbed the most valuable and Excel-lent tool ever devised, and did some number crunching. How good are the predictions? How many are right or wrong? When they’re off, how far are they off? How many games do they miss? How do they look across the divisions? In other words, can they tell us anything about that infamous “which division is the best in baseball argument?”
As always, here’s the data…I’ll get to analyzing in a bit.
The Big Misses
Bottom line, the 2036 Opening Day predictions had some big misses both ways. The game under-estimated Atlantic City by 22 games to the worse, and Jacksonville by 16. In the Frick, it judged Seattle to be 21 worse than they performed. Going the opposite direction, the software scouts gave Phoenix the benefit of the doubt by 22 games, Calgary by 23 games, and Edmonton by 20. It expected Louisville to win 14 more than it did.
In other words, it missed seven of our 30 teams by 14-23 games.
Close Enough For Horse Shoes and Hand Grenades
On the other hand, the game did get 14 teams “right” within 4 games, and even called Mexico City at 95 right on the button. So roughly half the league it gets "right." Not horrible when you look at it that way, eh?
Of course, this and $5 will get you a decent book on Amazon if you look around close enough. No one knows which teams are "right" and which are "wrong" until it's tool late. I suppose this would be fun to do with our Media Guide predictions and team previews, too. How close are we vs. the program. Maybe I don't want to know.
League-wide Look:
Here’s the league/division breakdown. Again, data first.
First, the big picture: The game does predict about the right number of wins (81 on average). So that’s good, And on the whole, the standard deviation of the estimator’s error calculated out to be about 10.9 games, suggesting that just under 70% of its guesses should be right to within 11 games. Yes, a pretty wide margin, but then we do realize that the game can’t really predict injuries of trades and other moves.
Look at the divisions, though.
How to read the data: Reading across the JLA, for example, the game projected the average JLA team would win 80.4 games, with a standard deviation of 17.1 games. That STDEV suggests that the game thought the JLA would be the least competitive division top-to-bottom (the spread between best and worst would be wider than the other divisions). The 2036 Actual results showed that the division was a little bit better than expected (83 wins), and, yes, at 16.2 STDEV, was not great, but it was better than the FLF’s 18.9.
Now that we’ve been through that, we can see that the game projected the division’s power rankings to be:
2036:
FLP – 84 wins (13.8 STDEV))
JLSB – 83.6 (13.0)
FLH – 83 (13.0)
JLA – 80.4 (17.1)
JLSE – 79.4 (7.7)
FLF – 77 (10.4)
In other words, for example, the JLSE was supposed to be the most competitive league top-to-bottom (it turned out to be #3). And it over-estimated the Frontier and Southeast by an average of 4.6 and 4 game each. The game under-estimated the Heartland the most (3.4 games), the JLA by a bit less (2.6), and the Southeast by only 2 games apiece. Its average error for the Pacific was a pretty reasonable .6 games per team.
Bottom line: the Heartland was the best division in baseball during the regular season, but the JLA and Pacific will be obviously right in lording their Landis appearances over the rest.
After seeing folks comment on the in-game predictions, I got to wondering…just how good are these estimates the game comes up with? Looking at the forum, I saw Recte posted this year’s predictions in the Sim #1 thread, and added a couple numbers together to have it dawn on me that maybe the predictions for last year were in the 2036 threads.
That’s right. I mean. You gotta get up pretty early to put one past me.
So, using last year’s data, I grabbed the most valuable and Excel-lent tool ever devised, and did some number crunching. How good are the predictions? How many are right or wrong? When they’re off, how far are they off? How many games do they miss? How do they look across the divisions? In other words, can they tell us anything about that infamous “which division is the best in baseball argument?”
As always, here’s the data…I’ll get to analyzing in a bit.
The Big Misses
Bottom line, the 2036 Opening Day predictions had some big misses both ways. The game under-estimated Atlantic City by 22 games to the worse, and Jacksonville by 16. In the Frick, it judged Seattle to be 21 worse than they performed. Going the opposite direction, the software scouts gave Phoenix the benefit of the doubt by 22 games, Calgary by 23 games, and Edmonton by 20. It expected Louisville to win 14 more than it did.
In other words, it missed seven of our 30 teams by 14-23 games.
Close Enough For Horse Shoes and Hand Grenades
On the other hand, the game did get 14 teams “right” within 4 games, and even called Mexico City at 95 right on the button. So roughly half the league it gets "right." Not horrible when you look at it that way, eh?
Of course, this and $5 will get you a decent book on Amazon if you look around close enough. No one knows which teams are "right" and which are "wrong" until it's tool late. I suppose this would be fun to do with our Media Guide predictions and team previews, too. How close are we vs. the program. Maybe I don't want to know.
League-wide Look:
Here’s the league/division breakdown. Again, data first.
First, the big picture: The game does predict about the right number of wins (81 on average). So that’s good, And on the whole, the standard deviation of the estimator’s error calculated out to be about 10.9 games, suggesting that just under 70% of its guesses should be right to within 11 games. Yes, a pretty wide margin, but then we do realize that the game can’t really predict injuries of trades and other moves.
Look at the divisions, though.
How to read the data: Reading across the JLA, for example, the game projected the average JLA team would win 80.4 games, with a standard deviation of 17.1 games. That STDEV suggests that the game thought the JLA would be the least competitive division top-to-bottom (the spread between best and worst would be wider than the other divisions). The 2036 Actual results showed that the division was a little bit better than expected (83 wins), and, yes, at 16.2 STDEV, was not great, but it was better than the FLF’s 18.9.
Now that we’ve been through that, we can see that the game projected the division’s power rankings to be:
2036:
FLP – 84 wins (13.8 STDEV))
JLSB – 83.6 (13.0)
FLH – 83 (13.0)
JLA – 80.4 (17.1)
JLSE – 79.4 (7.7)
FLF – 77 (10.4)
In other words, for example, the JLSE was supposed to be the most competitive league top-to-bottom (it turned out to be #3). And it over-estimated the Frontier and Southeast by an average of 4.6 and 4 game each. The game under-estimated the Heartland the most (3.4 games), the JLA by a bit less (2.6), and the Southeast by only 2 games apiece. Its average error for the Pacific was a pretty reasonable .6 games per team.
Bottom line: the Heartland was the best division in baseball during the regular season, but the JLA and Pacific will be obviously right in lording their Landis appearances over the rest.
- RonCo
- GB: JL Frontier Division Director
- Posts: 19976
- Joined: Sat Nov 14, 2015 10:48 pm
- Has thanked: 2011 times
- Been thanked: 2976 times
Re: Predictions Pre-Schmictions
Of course, I have to jump in with a look at the divisions for 2037, right?
Here's the data:
Bottom line, the game thinks the JLSB (87 wins) is the best division in baseball by a a large margin. The Pacific and Heartland are close together vying for second best, then comes the JLSE, the Frontier, and finally the JLA, who--per the game--has fallen on hard times. The game says the JLSE and Heartland will be the hardest fought divisions, and, again, the JLA to be romped through by Rockville.
Of course, we've seen just how far off the game can be.
So, yeah, let the fighting commence.
Here's the data:
Bottom line, the game thinks the JLSB (87 wins) is the best division in baseball by a a large margin. The Pacific and Heartland are close together vying for second best, then comes the JLSE, the Frontier, and finally the JLA, who--per the game--has fallen on hard times. The game says the JLSE and Heartland will be the hardest fought divisions, and, again, the JLA to be romped through by Rockville.
Of course, we've seen just how far off the game can be.
So, yeah, let the fighting commence.
- jiminyhopkins
- BBA GM
- Posts: 3514
- Joined: Mon Jan 31, 2011 2:33 pm
- Location: OH
- Has thanked: 303 times
- Been thanked: 933 times
Re: Predictions Pre-Schmictions
I don't think OOTP predicted my pitching injuries last season.
OR DID IT?????
OR DID IT?????
GM, 2051, 2053, and 2058 JL WILDCARD Phoenix Talons (2029-??), BBA
CARETAKER GM, 2053 GBC CHAMPION Tokyo Pearls (2053 - 2058)
GM, THE GREATEST MINOR LEAGUE TEAM OF ALL TIME Toledo Liberty
Vic Caleca Team News Award Winner: 2051, 2054, 2057
CARETAKER GM, 2053 GBC CHAMPION Tokyo Pearls (2053 - 2058)
GM, THE GREATEST MINOR LEAGUE TEAM OF ALL TIME Toledo Liberty
Vic Caleca Team News Award Winner: 2051, 2054, 2057
-
- Ex-GM
- Posts: 7681
- Joined: Tue Nov 20, 2012 10:30 am
- Has thanked: 21 times
- Been thanked: 47 times
Re: Predictions Pre-Schmictions
Someone just flashed the Ben Signal!jiminyhopkins wrote: ↑Wed Dec 12, 2018 2:32 pmI don't think OOTP predicted my pitching injuries last season.
OR DID IT?????
League Director: Kyle “agrudez” Stever*
*Also serves as chief muckraker
-Ron, 2025 media guide
*Also serves as chief muckraker
-Ron, 2025 media guide
- Lane
- GB: Vice Commissioner
- Posts: 6818
- Joined: Tue Feb 02, 2016 8:18 am
- Location: Los Angeles
- Has thanked: 532 times
- Been thanked: 719 times
Re: Predictions Pre-Schmictions
cool. thanks Ron
Stephen Lane
Vice Commissioner / Historian
General Manager, Long Beach Surfers
Since 2026
Ex-GM, Amsterdam Neptunes, 2025 EBA Champions
Vice Commissioner / Historian
General Manager, Long Beach Surfers
Since 2026
Ex-GM, Amsterdam Neptunes, 2025 EBA Champions
- niles08
- BBA GM
- Posts: 2507
- Joined: Wed Mar 29, 2017 9:15 pm
- Has thanked: 168 times
- Been thanked: 424 times
Re: Predictions Pre-Schmictions
Good stuff here! I would be curious how well it evaluated the preseason predictions on the batters and pitchers as well and where those players actually ended up falling.
-
- Ex-GM
- Posts: 3317
- Joined: Wed Mar 14, 2018 1:36 pm
- Location: South Riding, VA
- Has thanked: 728 times
- Been thanked: 485 times
Re: Predictions Pre-Schmictions
Predictions are really just something fun to mess around with. Once you start throwing trades, injuries, rookies, and of course, the weather in Mexico City, into the mix, all bets are off.
Brett "The Brain" Golden
GM: Nashville Goats 2034-2039 (The Plan® was working when I left!)
GM: Charlotte Cougars 2040-2052
GM: Rocky Mountain Oysters 2053-2057
2056 BBA Champions!
"Tonight, we take over the world!"
-- The Brain
GM: Nashville Goats 2034-2039 (The Plan® was working when I left!)
GM: Charlotte Cougars 2040-2052
GM: Rocky Mountain Oysters 2053-2057
2056 BBA Champions!
"Tonight, we take over the world!"
-- The Brain
-
- Ex-GM
- Posts: 2936
- Joined: Wed Mar 05, 2014 7:38 am
- Has thanked: 297 times
- Been thanked: 240 times
Re: Predictions Pre-Schmictions
This is really cool. As others have mentioned, it doesn't mean much, but it's fun.
Who is online
Users browsing this forum: No registered users and 5 guests