Reliever Rankings, Ignoring Saves and Holds
When playing typical fantasy baseball, the main thing that fantasy managers typically worry about regarding relievers is one thing: jobs. If a reliever is a closer, he has value. If not, they generally are considered to have very little value except in very deep leagues.
In FanGraphs Points leagues, however, a reliever’s job means a bit less, because saves (worth 5 points apiece) are worth only marginally more than a hold (4 points). With that in mind, I think it’s interesting to take a look at reliever rankings without worrying about jobs. In a sense, what we’re talking about are “true talent” projections for relievers, but still including things like park factors that do matter for fantasy comparisons. If you have an estimate of a pitcher’s true talent, you may be able to find that cheap bargain pitcher who will outperform bad relievers with jobs. And in all likelihood, the best pitchers would be expected to be among the first to take on the closer role once it becomes available.
So, here are reliever rankings, based on averaged, up to date, rest of season projections for ZiPS and THT’s Oliver. Because I play in FanGraphs Points leagues (and similar lwts-style leagues), I’m going to rank the players based on FIP, since that is the core of that scoring system. Here are the top-30:
| # | Name | Team | zFIP | oFIP | avgFIP | Closer? |
| 1 | Kuo, Hong-Chih | LAN | 2.72 | 2.80 | 2.76 | |
| 2 | Bell, Heath | SDN | 2.81 | 3.00 | 2.91 | YES |
| 3 | Thornton, Matt | CHA | 3.04 | 2.94 | 2.99 | |
| 4 | Marmol, Carlos | CHN | 2.96 | 3.07 | 3.02 | YES |
| 5 | Wilson, Brian | SFN | 2.93 | 3.11 | 3.02 | YES |
| 6 | Soria, Joakim | KCA | 2.89 | 3.23 | 3.06 | YES |
| 7 | Adams, Mike | SDN | 2.93 | 3.24 | 3.08 | |
| 8 | Broxton, Jonathan | LAN | 3.05 | 3.14 | 3.09 | YES |
| 9 | Rivera, Mariano | NYA | 3.27 | 2.93 | 3.10 | YES |
| 10 | Romo, Sergio | SFN | 3.11 | 3.09 | 3.10 | |
| 11 | Hanrahan, Joel | PIT | 3.07 | 3.21 | 3.14 | YES |
| 12 | Papelbon, Jonathan | BOS | 3.00 | 3.29 | 3.15 | YES |
| 13 | Madson, Ryan | PHI | 3.05 | 3.27 | 3.16 | YES |
| 14 | Gregerson, Luke | SDN | 3.09 | 3.39 | 3.24 | |
| 15 | Balfour, Grant | OAK | 3.16 | 3.45 | 3.31 | |
| 16 | Marshall, Sean | CHN | 3.20 | 3.44 | 3.32 | |
| 17 | Putz, J.J. | ARI | 3.12 | 3.53 | 3.32 | YES |
| 18 | Feliz, Neftali | TEX | 3.23 | 3.45 | 3.34 | |
| 19 | Robertson, David | NYA | 3.30 | 3.39 | 3.34 | |
| 20 | Betancourt, Rafael | COL | 3.49 | 3.34 | 3.42 | |
| 21 | Soriano, Rafael | NYA | 3.51 | 3.35 | 3.43 | |
| 22 | Jenks, Bobby | BOS | 3.39 | 3.50 | 3.44 | |
| 23 | Street, Huston | COL | 3.42 | 3.48 | 3.45 | YES |
| 24 | Benoit, Joaquin | DET | 3.33 | 3.62 | 3.48 | |
| 25 | Francisco, Frank | TOR | 3.22 | 3.73 | 3.48 | |
| 26 | Rodriguez, Francisco | NYN | 3.28 | 3.69 | 3.48 | YES |
| 27 | Nathan, Joe | MIN | 3.43 | 3.56 | 3.49 | |
| 28 | Qualls, Chad | SDN | 3.45 | 3.59 | 3.52 | |
| 29 | Belisle, Matt | COL | 3.67 | 3.39 | 3.53 | |
| 30 | Bray, Bill | CIN | 3.53 | 3.57 | 3.55 | |
| 31 | Farnsworth, Kyle | TBA | 3.50 | 3.61 | 3.56 | YES |
Of the top 31, 13 are currently closers. And another 7 or 8 have been in that role in the recent past (including some who have already lost the job this year!). Clearly, most teams do put their top (or one of their top) relievers into the role of closer. That’s not surprising. But even so, I think there are a lot of surprises on this list. For example, how many would have guessed that Hong-Chih Kuo would have the best FIP projection…by a considerable margin, no less? And while park factors do come into play, San Diego’s bullpen is just beyond stacked with top-tier talent. Also, you can see why I was pretty confident in Joel Hanrahan when he was given the closer job this spring (and before he had a terrific April…although, what’s going on with his strikeout rate this year?).
I wouldn’t recommend using this as the only determination of how you draft relievers, even in leagues like ottoneu (I sort of tried that this year, and I’m getting killed). The typical closer will still get more save opportunities than setup guys will get hold opportunities, for example, and saves still count for more. But this is a good reference to use when going after non-closers, whether you are prospecting for saves or just going after reliable setup men.
What about the rankings of true closers? Here are the current (and I mean current, so Neftali Feliz is replaced by Darren Oliver) closers for MLB teams:
| # | Name | Team | zFIP | oFIP | avgFIP | Closer? |
| 1 | Bell, Heath | SDN | 2.81 | 3.00 | 2.91 | YES |
| 2 | Marmol, Carlos | CHN | 2.96 | 3.07 | 3.02 | YES |
| 3 | Wilson, Brian | SFN | 2.93 | 3.11 | 3.02 | YES |
| 4 | Soria, Joakim | KCA | 2.89 | 3.23 | 3.06 | YES |
| 5 | Broxton, Jonathan | LAN | 3.05 | 3.14 | 3.09 | YES |
| 6 | Rivera, Mariano | NYA | 3.27 | 2.93 | 3.10 | YES |
| 7 | Hanrahan, Joel | PIT | 3.07 | 3.21 | 3.14 | YES |
| 8 | Papelbon, Jonathan | BOS | 3.00 | 3.29 | 3.15 | YES |
| 9 | Madson, Ryan | PHI | 3.05 | 3.27 | 3.16 | YES |
| 10 | Putz, J.J. | ARI | 3.12 | 3.53 | 3.32 | YES |
| 11 | Street, Huston | COL | 3.42 | 3.48 | 3.45 | YES |
| 12 | Rodriguez, Francisco | NYN | 3.28 | 3.69 | 3.48 | YES |
| 13 | Farnsworth, Kyle | TBA | 3.50 | 3.61 | 3.56 | YES |
| 14 | Oliver, Darren | TEX | 3.69 | 3.50 | 3.59 | YES |
| 15 | Fuentes, Brian | OAK | 3.38 | 3.90 | 3.64 | YES |
| 16 | League, Brandon | SEA | 3.61 | 3.71 | 3.66 | YES |
| 17 | Valverde, Jose | DET | 3.65 | 3.73 | 3.69 | YES |
| 18 | Perez, Chris | CLE | 3.63 | 3.89 | 3.76 | YES |
| 19 | Santos, Sergio | CHA | 3.43 | 4.10 | 3.77 | YES |
| 20 | Lyon, Brandon | HOU | 3.86 | 3.83 | 3.85 | YES |
| 21 | Axford, John | MIL | 3.64 | 4.11 | 3.87 | YES |
| 22 | Kimbrel, Craig | ATL | 3.62 | 4.14 | 3.88 | YES |
| 23 | Capps, Matt | MIN | 3.86 | 3.91 | 3.88 | YES |
| 24 | Nunez, Leo | FLO | 3.68 | 4.12 | 3.90 | YES |
| 25 | Storen, Drew | WAS | 3.50 | 4.31 | 3.90 | YES |
| 26 | Cordero, Francisco | CIN | 4.04 | 3.86 | 3.95 | YES |
| 27 | Rauch, Jon | TOR | 4.03 | 3.94 | 3.98 | YES |
| 28 | Gregg, Kevin | BAL | 4.11 | 4.24 | 4.18 | YES |
| 29 | Boggs, Mitchell | STL | 3.94 | 4.51 | 4.22 | YES |
| 30 | Walden, Jordan | ANA | 4.16 | 4.55 | 4.36 | YES |
Not surprisingly, the bottom of the barrel is where you get the most movement and the least amount of job security. Mitchell Boggs has been getting a lot of press as he assumed the job this year, for example, but I wonder whether he’ll keep it for the rest of the year given his weak projection. Oliver and ZiPS do think he was a small upgrade over Ryan Franklin (4.36 projected FIP), though Jason Motte may be the best pitcher of the group (3.62 projected FIP). Also, while the typically awesome Matt Thornton arguably should have gotten a longer audition for the job, Sergio Santos doesn’t look like a half-bad choice for the White Sox gig; he’s right there with Chris Perez in the rankings.
Justin is a lifelong Reds fan, and first played fantasy baseball on Prodigy with a 2400 baud modem. His favorite Excel function is the vlookup(). You can find him on twitter @jinazreds, even though he no longer lives in AZ.
Ignoring saves and holds? That’s like ranking girls and ignoring looks and manual dexterity. This is a roto article, captain!
Assuming you’re in a league with ERA and WHIP (and even K), it’s more like ranking girls and ignoring their face and chest.
Maybe he’s an ass man
But I like being the ass man!
It’s a fantasy article, in this case using FanGraphs Points or a similar scoring system. … though I do think it still has relevance for category leagues, especially deep ones or (certainly) ones that count holds.
-j
surprised that joe nathan ranks far ahead of matt capps.
The projection systems know Nathan didn’t pitch last year, but don’t know why. You have to bump a guy upwards or downwards based on scouting/injury information that should alter his projection.
-j
We should probably tell those scoring systems that information. They’re never going to win any leagues with that sort of abject ignorance. 😉
Wow, why in the world would you have holds and saves valued so similarly? I agree that saves are overvalued, but at least you can’t get one while being charged with a loss as well. Holds are, in my opinion, the silliest stat in the game.
The point of saves and holds is to recognize the higher leverage situations that relievers throw in compared to starting pitchers. Both stats are ultimately stupid, but we don’t otherwise have a good way to reward relievers for leverage. Holds are given the weight we give them to reduce the importance of the almighty save, which lets fantasy managers focus more on reliever talent than the insanity of closer selection by MLB managers.
Shutdowns/meltdowns might be an ideal alternative, but those can change over the course of a season as park factors and such are adjusted. That makes them problematic for fantasy games: imagine the outrage if a shutdown was retracted a month after it was given because a park factor changed the calculated leverage or win probability effects of an appearance.
It’s not my call, but I think we probably could just get rid of saves and holds altogether and still get decent value out of relievers, since they will tend put up more points per inning than starters by default. But I think the current solution works pretty well.
-j
I agree that the shutdowns/meltdowns metric might be better. I just hate holds, I feel like they are a stat, like Quality Starts, that has been created to shoehorn value onto players in the modern game (of overused bullpens and hard pitch-count starters) that don’t really deserve it. Like I said before, any ‘positive’ stat you can accrue while blowing a win for your team should not be a fantasy category.
I actually think quality starts is a decent little stat. The winning % for teams who get a quality start is pretty high… And based on this:
http://en.wikipedia.org/wiki/Quality_start
The average ERA in a quality start is 1.91. I don’t love them, but I like QS’s better than wins…
But anyway, regarding holds, you can’t actually give up the lead and get a hold. You can be charged with the losing runs and the loss if a later pitcher allows the game to be lost, but you can’t actually give it up. It’s not a good performance either way, but the rules around who gets charged with runs, and who gets charged with a loss (and especially a win) are arguably just as flawed.
Again, the point is just to give relievers something extra to recognize the leverage they pitch in. Saves work for closers, but they’re not the only important relievers…and chasing saves sucks.
-j
Using holds is a way to take some of the value away from closers in fantasy baseball. In a NL or AL only league, there are only 16 or 14 closers at a given time. In a 10 team league that leaves only 1.6 or 1.4 closers per team, which puts those players at quite the premium (either way overpriced in auction or way overdrafted in snake drafts). Holds are harder to predict and amass for the most part, so it also tends to make for a more exciting waiver wire as well.
As for quality starts, I also agree it’s a better stat than wins. Too many times I’ve watched my pitchers (Dan Haren this week…) pitch one hell of game and not get any credit for it in the win column. If you use a stat QS + Ws you create a way to both reward a starter for a good outing and the win. You get a higher point total, but at least you get something for a great game by your starter.
Just something to chew on.
I completely agree with Justin and Rob here. I love Holds as a fantasy category. It opens up the player pool to a whole new, talented, valuable class of pitchers who may otherwise go completely ignored in a mixed fantasy league. The Hold isn’t a perfect stat, but I don’t think it’s particularly more flawed than the Save. Projecting Holds takes skill, and it also shifts the emphasis on fantasy bullpens to projecting and going after quality performance rather than chasing jobs and the whims of mercurial managers.
The roto league I run has Holds and Quality Starts in addition to the standard Ws, SVs, Ks, ERA and WHIP. To balance it out on the other side of the ledger the offensive categories are Runs, RBIs, HRs, Steals, Hits, OBP and SLG (and not AVG). We’ve been doing it for a couple years now and been very pleased with the balance between power and non-power hitters, relievers and starters and chasing actual quality performance with traditional fantasy stats.
I’ve been looking for a list like this FG. Thanks! I am in an 11×11 roto ESPN league that limits starts to 154. This league counts inning pitched, saves and appearances but not holds. There are 6 pitching spots, 2 SPs, 2 RPs, and 2 P spots. Basically warm bodies are needed to fill these spots regardless of saves and holds. You can significantly pad your K, IP and appearance stats by keeping all your pitching spots filled everyday. Finding stud relief pitchers with SP/RP eligibility are rare gems. Last year relief pitchers like Luke Gregerson and Clay Hensley were invaluable.
Please continue to breakdown relief pitching this way for those in a similar predicament.
ESPN League:
http://games.espn.go.com/flb/leagueoffice?leagueId=112293
my team is “I Hate My Team”
Glad you liked it. If folks would find it useful, I can post all of the relievers in a google spreadsheet instead of just the top 30 or so. Just let me know.
-j
yes, please do
You are missing Frieri from the Padres. He has been pitching out of his mind (both this year and last year) and his stat page here on fangraphs shows some pretty awesome numbers. The Padres pen is Bell, Adams, Gregerson, Frieri, etc… in terms of top-down.
http://www.fangraphs.com/statss.aspx?playerid=5178&position=P
Although it isn’t clear to me where your numbers came from for the above charts.
Numbers come from the ZiPS and Oliver RoS projections, as of a day or two ago.
The two systems differ massively on Frieri. ZiPS projects a 3.66 FIP by my calcs. Oliver projects 5.11 FIP. Oliver sees a high walk rate and very bad HR allowed rate, and isn’t as impressed with the k-rate as ZiPS. So, an average puts him at 4.38.
The Oliver projection does include some starts, so that’s a factor that may be bumping up his projection. FWIW, Baseball Prospectus’s projected ERA for Frieri is 4.15, so ZiPS is a bit alone in where it has him.
-j
OK, thanks for the information.
But yeah, the past two years he has been used in the majors as a pure reliever in the tradition of Bell, Adams, and Gregerson (and others before them). I think a lot of fans, including me, see him as the next one to slot into our 7-8-9 once Bell is traded away.
Frieri is nasty. Q from the uninformed, does Walden’s presence at the bottom of the list spell impending doom, or am I … well… wrong.. lol?
I can’t foretell the future…but Walden’s 2011 numbers are a lot closer to his projected k/9 and bb/9 rates than his 2010 numbers (albeit in ~10 innings each year!).
He’s another case where ZiPS likes him better than Oliver. Oliver’s projecting 7 k/9 and 4.5 bb/9, which is not particularly impressive. But he also doesn’t have a huge track record as a reliever, especially in the majors…that can make a big difference in a projection.
Whar es Jonny Venters?? I guess the projections must hate him, but I’ve no clue why. Already a solid season of 2.69 FIP under his belt, lower than the lowest zFIP amount, and he’s dominating again this year. But no love from either projection system…
Perhaps this is why ottoneu isn’t going so well for you.
-C
Overspending on setup guys is part of the reason. Another is pretty much all of my big money players getting off to poor starts. It’s a long season–we’ll see.
Venters: 3.75 zFIP, 4.08 oFIP. Terrific year last year, but it’s still just 95 innings total. And while he was almost always starting–which again is always a factor that will bring down rate projections–he sort of sucked. Go look at his numbers. He may be one of those guys that is particularly well suited to relieving, but to go from what he did in 2010 after a 5 k/9 rate in 2009…I dunno, makes me nervous. The projections are giving him a lot of credit for what he’s done in the majors, but they’re still accounting for what happened in the minors.
-j
I would have to think that Chapman ranks pretty high on any non-closer reliever list. High K’s, low WHIP, low ERA.
I was going to mention Chaoman, but forgot. The projections have his walk rate as other-worldly awful right now (like 6 bb/9) and give him low projections as a result. I think the systems are suffering from inadequate data sample data, and tend to let scouting inform my evaluation of him right now. I wouldn’t rank him first, but definitely in the top 30. -j
projections for relievers have, and always will be, of doubious value so I wouldn’t sweat Venters. Kimbrel has 6 saves, is striking out 12 per 9, has an ERA of .87 and is listed 22 on the closer list. Now it’s only a month but with a K rate like that he should be higher.
LOL @Broxton 8th
Broxton ranked #8? Not in 2011. Not with a 91-93 fastball that has no movement.
Right, these are projections based on standard stats, and know nothing of scouting info like fastball velocity. At some point, we’ll get projections that incorporate both. Until then, we as end-users need to modify them to account for scouting/injury info. The same is true of Nathan. -j