Using xK and xBB With SIERA
Expected ERA metrics like SIERA, FIP and xFIP are one of the best sabermetric developments we have benefited from in recent years. No longer do we have to eye the various luck rates and attempt to make mental calculations as to how lucky or unlucky a pitcher has been. Expected ERA metrics do the work for you and spit out a number on the same scale as ERA so you could quickly identify those pitchers benefiting from good fortune and those who have not.
Unfortunately, as great as the expected ERA metrics are, they work best if the inputs have little statistical noise. For example, they all heavily rely on a pitcher’s strikeout and walk percentages. But what if those rates themselves are a bit flukey over smaller sample sizes? You know the saying, garbage in, garbage out. So I decided to take my recently published formulas for both expected K% and expected BB% and plug them into Matt Swartz’s SIERA formula. The idea here is that this might be an even more accurate picture of how well a pitcher has pitched.
So I began by combining FanGraphs and Baseball Reference data once again to get all the relevant metrics on one spreadsheet. I then started with the following formula provided by Matt.
SIERA = constant – 15.518*(SO/PA) + 9.146*((SO/PA)^2) + 8.648*(BB/PA) + 27.252*((BB/PA)^2) – 2.298*(netGB/PA) –/+4.920*((netGB/PA)^2) – 4.036*(SO/PA)*(BB/PA) + 5.155*(SO/PA)*(netGB/PA) + 4.546*(BB/PA)*(netGB/PA) + .367*(IP as SP)/(IP total)
*netGB = GB – FB
**The -/+ term is determined based on whether or not GB >= FB. If it is, you would use the minus sign, otherwise if FB > GB, use the plus sign.
I first had to calculate this myself, rather than rely on the published SIERA marks on the player pages, because I needed to figure out what the constant is. It turned out to be about 5.65 and after several player page checks, the SIERA marks matched for all.
I then calculated each pitcher’s xK% and xBB% and substituted those expected marks for their actual marks in the SIERA formula. However, I actually used slightly different versions of the formulas I linked to in the second paragraph. Turns out, using Str% from Baseball Reference improves the adjusted R-squared for xK% by a marginal, but meaningful degree, so I used this new formula instead.
I then noticed a problem with the xBB% calculations. On average, they were a bit on the high side, with the average pitcher owning an xBB% about 0.4% higher (or a little more than 5% greater) than his actual BB%. Since the xBB% formula wasn’t as strong as the xK% formula to begin with, I decided that it should be scaled down just to match the BB% average. So I simply reduced each pitcher’s by the same rate so the average of the xBB% and BB% columns were about even.
Because I still feel we have much more room to improve the xBB%, this can provide us a new way of looking at SIERA. It’s just a matter of substituting the best xK% and xBB% marks with the pitcher’s actual SO/PA and BB/PA marks in the current formula.
This new SIERA could be compared with the pitcher’s actual SIERA marks and then sorted. Tune in tomorrow to see the results and learn which pitchers’ SIERA marks should actually be higher or lower given their xK% and xBB% marks.
Mike Podhorzer is the founder of ProjectingX IQ, an advanced fantasy baseball analytics platform that transforms projection data and in-season performance signals into actionable intelligence. He is the 2015 Fantasy Sports Writers Association Baseball Writer of the Year and three-time Tout Wars champion. He is the author of the eBook Projecting X 2.0: How to Forecast Baseball Player Performance, which teaches you how to project players yourself. Follow Mike on X@MikePodhorzer and contact him via email.
Whoaaa, so this is like an expected expected ERA? That’s meta.
So the new xBB% formula is the same as the previous one, but minus 0.4%?
xMETA?
Haha, ’tis true (to the expected expected ERA). The adjustment I made to xBB% was just for this particular exercise. I wanted to make sure it scaled given the data population, but it might be a bit different in another population. It would be much easier if we could just figure out a really good xBB% though!
Well, the point you brought up in your article on xBB% was that you needed to take into account sequencing. Maybe looking at splits and taking into account a pitcher’s control on 3 ball counts would help? You could add zone% on 3 ball counts, or Str% on 3 ball counts. I’m not sure if that’s a repeatable skill or not, but it might be. It seems plausible to me that there would be some pitchers who have great control but throw more balls than you would expect early in counts trying to get hitters to chase. Then, if their control is really great, they’re able to pound the strike zone on a 3 ball count. Just a thought.
This looks awesome and I can’t wait to put it to use! If I may make a request for the pipeline: those less mathematically and sabr-inclined (there’s got to be a few of us around here) would appreciate a primer piece on how all these expected ERA tools should best be leveraged by a fantasy manager. Right now I split the difference between xFIP and SIERA for judging pitching pickups and I have no idea if that’s really advisable!
Yes, yes, yes. A one-stop, comprehensive “Idiot’s Guide to Looking at Sabermetric/Non-Traditional Stats to Get Ahead in Your Plain-Vanilla Stats League” would be an epic service.
First off, there’s no real reason to split between ERA estimators. I use SIERA exclusively. It’s much more comprehensive than xFIP and Matt found it to be better.
Next, a primer you ask? I hate to promote my eBook in the comments, but http://www.projectingx.com will tell you everything you want, plus explain how to create an Excel spreadsheet to develop your own projections.
I’ve spent all morning trying to figure out the mathematical way to get rid of that -/+ term. The best I can come up with is “-sgn(GB-FB)” and I think that’s actually more confusing than what you have up there.
I would also be interested in that primer shibboleth mentioned; if it already exists, where can I find it?
Assuming you are using excel just create an if statement with the second half of the equations sign determined by GB relationship to FB
Yup, that’s exactly what my massive Excel formula was, one huge IF statement.
I LOVE LOVE LOVE SIERA. I’m not even kidding. It is my one single favorite thing on this entire website, just a hair ahead of Hot GIF Action on NotGraphs.
One thing though. SIERA makes me incredibly frustrated with guys like Roberto Hernandez and Rick Porcello. I’m hoping your new calculations will shed some light on the outliers.
I feel your pain, re: Hernandez and Porcello. What’s with those guys?
Unfortunately, it won’t shed any light. There are guys who consistently outperform and underperform these metrics, just like outliers in anything. The xSIERA isn’t going to make these pitchers look any different because the underperformance is due to perhaps a difference in luck metric (BABIP, HR/FB, LOB%) skill.
http://johnricco.tumblr.com/post/54352909030/expected-everything
…seriously?
He created an entire tumblr solely to post that! I feel so honored. Hey, if nothing else, it’s more links to my work.
I found a number of serious issues with the approach here, and I addressed them in a response. Seriously.
Love this. I’ve tuned in tomorrow (today) and the results are where?
Unfortunately, tomorrow isn’t coming. We have decided to develop the formulas further before using them to analyze specific players.
John Ricco 1 – Mike Podhorzer 0
what happened with this?
when are you planning to include it? Thanks.