For the longest time I was a big time fan of stats.  It was fun to stare at.  I mean who doesn’t like seeing massive numbers?  But the deeper I got into leading raids the more skewed I began to see the statistics.  We had a fury warrior in our 25 man raids who always topped the damage charts.  And yet the raid leaders seemed to all agree that while his numbers were impressive, they came at the expense of true focus and benefit of the raid.

So what are the appropriate methods of using stats?  Should we be publishing the stats in general or should we keep them private?

The Devil In the Details

In a lot of cases, stats are used improperly.  I know… I’ve done it too… we all have.  We pull up our handy dandy Recount (or whatever your favorite program is) and go…. “aren’t I cool?  Look at that… 700DPS.  I have more damage than anyone.”  Or “OMG… I did 45% of the healing and we have 3 healers.  I must be good!!!”  Said Recount is then posted to all of the guild so people can oo and aaah.

The reality is that those numbers are nice… but they don’t mean anything.  Fight to fight you’re role may differ.  A rogue assigned to kicking duty for the night will have lower DPS than a Warlock assigned to AOE duty in Mt. Hyjal.  Both serve a valuable role, but you can’t judge yourself top of the heap due to a fight that’s custom built for you. 

Another important point is that certain numbers have no meaning when evaluated individually.  DPS…. sorry but DPS does not = damage done.  If you look at a tool like Recount or Web Stats, you’ll find some interesting discrepancies that can be hard to spot initially.  First you look at DPS numbers.  You’ll see the average, 400, 500, 650, 1000, 3000 etc.  However then if you look you’ll also see total damage done.  Very frequently you’ll see a person on top of the chart with 1000, or 1500 DPS.  Also in the top five will be someone who does 600-800.  They aren’t in that exclusive four digit club, but they did some very nice numbers. 

How Did they accomplish this feat of strength?  Did they cheat?  Did they skew the numbers?

No… what they did, is they had a lot more of what I like to call ToT.  ToT stands for Time on Target.  I’ll take an average person with a very nice and consistent ToT over an idiot who can do 1000DPS, but hits the wrong target… or dies in a horrific blaze of glory after they top 1200 DPS and get two or three other people killed in the process.  High DPS doesn’t mean you’re doing what you need to be doing.

The Teaching Tool

Ok so we’ve seen is the horror side of these tools.  Lets move on to some better ways to look at these tools. 

The nice thing about most stats tools is that it lets you look at a running average as well as specific key fights.  So for instance lets say you have two similarly geared hunters in your raid.  Both are using stock standard Beastmaster builds.  One has higher DPS and the other always has very consistent damage.  In this scenario, you can use a tool like Recount to help train up both hunters.

Odds are high if you look at the breakdown of where both of them did their damage, you’ll most likely see a difference in how their damage is spread.  One may have a very distinctive steady shot/auto shot rotation.  The other person may have a very erratic shot rotation.  Either way, you can use the tool to examine their damage abilities to see what they are getting the most milage out of.  The great part is that you don’t have to know the fine details of the rotation.  You can quickly tell though that the two differ by the abilities they use and perhaps how often one applied Scorpid Sting vs. Serpents sting.  If one shows 6 applications of a freezing trap and the other shows none, then you may figure out the dps difference right there.

The trick is with these tools that you have look at the fights individually as well as an average.  If a warlock walks into Gruul and gets assigned “Doggied” duty, their DPS and damage numbers for the night will be horrible compared with the warlock who got to just blast away.  You need to evaluate the whole of what a person is casting and what they are doing from fight to fight to get a picture of if things are working as advertised.

For raid leaders its very nice to use these types of tools in raid to determine what went horribly wrong.  By reviewing things like the death log, you can see the last 20-30 seconds of a person’s life.  You can figure out if they died in a void effect or if it was just plain unlucky positioning.  You can also see how the healing went on the last 20-30 seconds of one person’s life.

All of these pieces of information are invaluable for a raid leader to make sure that people are doing what they are supposed to be doing, doing appropriate ability rotations, avoiding damage and working on the right target.  The trick is as a raid leader to realize not to use them for ePeen.  Damage is nice.  Damage is good, but damage doesn’t mean anything if you aren’t killing the mob/boss.

Not Beating Oneself Up

One of the hardest things you need to learn when looking at these tools is to look at them objectively.  We had a rogue in our alliance that was getting extremely upset with herself in Mt. Hyjal over her DPS.  She kept beating herself up over and over again trying to figure out what was going wrong.  It took a while, but one of the raid leaders finally pointed out that she’d been assigned to “kick duty” on some caster mobs.  She wasn’t taking this into account and was beating herself up over her DPS when she was providing valuable savings of damage to the raid by interrupting caster mobs.  Its hard to see the forest from the trees, but if presented with some stats, always try to put them in context. 

Don’t be mad at yourself for not being in the top 10 DPS if all of the trash pulls are AOE pulls and you don’t have an AOE effect.  Don’t be mad at yourself for having crappy DPS on a boss that’s immune to your standard spell/ability rotation. 

Do review the stats to see what abilities you are using are getting you the best bang for the buck.  Do look at the stats to see if you were taking damage you shouldn’t have been.  Do look at the stats to see if someone else who plays your class is putting their damage somewhere else and having it be more effective.

7 Responses to “Stats: Devil or Angel?”
  1. Crashandburn says:

    This is the biggest problem when people use stats as a way of trying to inflate their own sense of worth in the raid, rather than how well they’ve managed to play in a group. I can sympathise with your rogue when you’re required to keep energy or combo points for certain moves it will destroy any damage rotation that would get you up with the SoC spamming warlocks.

    We introduced a rule on our raids: If you pull aggro from the tank, you don’t get to claim how good your dps was compared to the rest of the raid, as you were obviously just going for the numbers rather than using good group etiquette.

    Crashandburns last blog post..WTB: Patch 3.0.3

  2. Nibuca says:

    See also:
    How to analyze your WWS reports as Affliction http://wowmb.net/forums/showthread.php?t=26423&highlight=Affliction
    Improving Hunter Raiding: WoW Web Stats http://35yards.wordpress.com/2008/07/24/improving-hunter-raiding-wow-web-stats/

    both were written pre 3.0.x but most of the information still holds true.

    Nibuca
    http://chicanery.fibergeek.com/

    Nibucas last blog post..Raid stacking 3.0.x

  3. Starman says:

    That is super helpful Nibuca. Thank you again. I’ll flip through those. If anyone else knows a good post on analyzing WWS stats for specific classes let me know.

  4. Xtian says:

    Cookies for this post!

  5. Herc says:

    Hi! New reader here. Nice post!

    Of course there will be situations where class x will do better than class y in situation a rather than B. There are melee friendly fights and caster friendly fights. You have to know those fights.

    Sometimes you have to explain to other people the meaning of that stat. Like yes they were top dmg but they were only doing 1100 dps while the 2nd and 3rd were pulling around 1400 hmmm something is wrong here…. or like last night our Spriest was pulling 1940 DPS but still ended up 15th he said it wasn’t fair and I kinda agree. 3.0 has been really all about physical dps.

    Our Guild leaders are smart enough to know which fights favors/cripples who BUT at the same time if you have a comparable gear with somebody and lagging in DPS/healing by a large margin like getting beat by your fellow warlock who is just spamming searing pain in KJ… something is wrong like bad and thats where the stats helps. Is it your talent? rotation(lol locks have rotations now? <3)? enchants?

    At the same time it is your responsible as a DPS to hold your aggro, got a problem with the tank? Talk to officers or compare him with other tanks how much Threat per Second they do? Maybe his gear? His rotation? He sucks?

    Like you mentioned having a mod that shows how the person died helps alot. Did they use a healthstone before they died? Did they crater in Archimonde or died in midair? Only 1 HOT in tank?

    Stats are a great tool to maximize your raid. But if you can’t interpret it and put those numbers to good use then it’s just a waste.

    Herc

    Hercs last blog post..Help! Prepartions for Wrath … what to do.

  6. PsychoChris says:

    I think your more experienced players know better than to compare anyone person against another unless they are the same class doing the same task…which will almost never happen.

    The big advantage i have found to WWS, is that it maintains data for a while, so I can compare my run this week against what I did last week. These meters are really only usefull for self evaluation, and maybe some educational discussions. To use them as an evaluation tool comparing one person to anothe is silly. Now if you see raider A, picked up 3 new peices of primary spec gear last week and still hasn’t improved their performance, maybe its time for a discussion.

    1) Everyone has a different idea of what is the most important stat. (some say DPS, others damage done, threat pulled…..the list goes on)
    2) No two people in the raid have the exact same responsibility. Fundamentally, yes, all your healers have the responsibility to heal, but perhaps your MT healer has bad numbers because your MT has awesome mitigation. Not a bad healer, maybe a bad raid leader for putting a good healer on a mediocre healer’s job.
    3) There is no meter for adeptation. Our raids never go exactly as planned, so having a hunter who traps in front of healers is a huge asset, even though he will almost never get recognized for it.
    4) There is not LAG meter. The # DPS killer, a slow machine or rough connection. My DPS can sway +/- 350 DPS just based on how much lag I am getting. And many times lag is beyond the control of the person playing. I can have 117 ping or 350 depending on weather, or just bandwith on the IP server.

  7.  
Trackbacks
  1.