1 Aug 2011

Review: PingCraft LagKiller (Part 1)

Warcraft can be a challenging game at the best of times. Whether it’s fighting raid bosses, battling it out in arenas or just trying to cram daily quests into our hectic schedule we all want to be playing at our best.

There’s various things as gamers that we can do to improve our game time. One is making sure we’re using a computer with enough grunt to handle our favourite MMOs. The next is to select keyboards, mice and other peripherals that support our individual styles of play.

The final piece is our internet connection to the game servers. This is the one thing we sometimes struggle with. You can spend ages trying to pick a good ISP or even move house to get better speeds. Sometimes though there’s pretty much nothing you can do.

This is where latency reduction and tunnelling services like PingCraft’s LagKiller come in – aiming to reduce your in-game latency for a small monthly fee. But does it actually work or is it just some snake-oil scam? Time to put it to the test.

Services like LagKiller aim to reduce network latency through a combination of tunnelling and proxies, redirecting your Warcraft traffic through their server network instead of relying on your ISPs peering arrangements. These types of service aren’t against Blizzard’s Terms of Use (WoW Insider’s Lawbringer series did an article featuring them recently), but they can trigger an account lock through false positives.

Although LagKiller is designed to work with any MMO that uses TCP, I decided to stick to using World of Warcraft for testing purposes. This is partly so I could build up a healthy stack of data, but also I could use the Addon framework in order to measure ping times as reported in-game. I used a modified version of shPerformance in order to measure latency and bandwidth every 30 seconds (as often as Warcraft updates these values) and output the results to a chat channel. I then used WoWScribe to record these values.

World of Warcraft reports two ping values. For the purpose of this test I’ve logged and compared both types to provide more in-depth analysis.

  • Home ping is your connection to the realm server (Earthen Ring EU in this case). Chat data, guild chat and info, auction house data and so on are all sent using this connection. Unless you’re doing an auction house scan this connection is usually fairly lightweight.
  • World ping is your connection to the environment server. Information on combat, nearby player data (specs, gear and enchants) and NPCs (vendors, quest givers, hostile mobs etc) all use this connection. It’s also used for casting and professions – basically everything that doesn’t involve the realm server.

Starting the Test

Testing was done using a single PC running Windows 7 Ultimate Service Pack 1. You can find more information about the test PC used here. Real-world conditions were used – I performed daily quests in the Molten Front, ran heroic dungeons until my eyes bled and sat around in Stormwind waiting for an auction house scan to finish or the LFG queue to pop. I always connected to the same realm (Earthen Ring EU) as not all realms are in the same datacentre. Wowpedia has lists of both EU realms and US realms by datacentre.

I should also declare some factors that may influence test results. As I was only using a single PC, testing was not simultaneous and did take place at different times  for when the service was enabled and disabled. All sample collection was performed midweek at the same time of day but on different days, so network variances could creep in. This also means that sample sizes are not identical. If you’re interested in testing it out for yourself, PingCraft do also provide a limited trial of their service, allowing you to check it against your own setup before taking the plunge.

For the occasions where I was using LagKiller, I allowed it to automatically select which servers to use and left it to run automatically. When in use it also provides its own bandwidth monitor and some details on which servers it has connected to.

Why go to all this effort to measure any change? I’m one of the fortunate few who has a good quality service through a great ISP. I also chose where I live based on the distance from the telephone exchange, so I get a superfast connection as standard. As I couldn’t just rely on perceiving any difference in play I needed to have something to measure ping more accurately.

The Results

I’ve broken down the results into three categories were the majority of testing was carried out. I’ve presented the results using a percentile Cumulative Histogram in order to allow comparison between when the service is in use and when I’ve disabled it. I’ve used this method rather than comparing averages as ping times can vary wildly during play.

The first set of results (and the easiest to process) are from me being sat around in Stormwind City. You can see that while I have a pretty good connection my ping times (in blue) can vary wildly, especially to the World server due to the sheer number of other people there doing their own thing.

By contrast, using LagKiller (in green) had a major effect. While my lowest measured ping is still the same (as I said, I have a great connection normally), the overall variance of pings is hugely reduced and the connection is tightened up overall.

Sitting around in Stormwind is all well and good, but how about some actual combat? How about the Molten Front daily quest hub? For these tests I measured latency while carrying out the various daily quests inside the Molten Front only (excluding the time spent outside in Mount Hyjal).

Again, it’s easy to see the difference that LagKiller has made to the connection. Although the lowest ping time is the same the variance is much tighter with the service enabled.

To round of this batch of tests I recorded some test data as I went through the process of completing LFG heroics for those highly desirable valour points. It’s this test that produced the most interesting set of results so far.

The first thing you’ll notice is that all four curves are much tighter as my good quality connection handles the restricted amount of players and carefully controlled combat levels easily. You’ll also notice that LagKiller continues to provide the best overall result and showing the lowest variance in ping times.

The curious artifact is the ‘scoop’ in the PingCraft Ping(world) trace from about 80%. I’m not sure what’s causing this and would need to investigate it further. Current theories suggest that it’s due to the way LFG groups are assembled. As we only have one LFG pool in the EU, it’s not clear which datacentre is selected to host that LFG instance. As such, even though mu connection to the Frankfurt datacentre is used for my realm, the LFG session may be held in Paris. As Paris is closer than Frankfurt to me, it could possibly generate this kind of result.

The observant among you will have probably noticed that there’s two areas I’ve not tested. The first one is raiding, and I’ve not presented plots of results from Firelands raids purely due to sample size. I figured that the best numbers would come from real world raids, not from kiting scorpions or turtles round in circles in the hope of epics. I’ll hopefully be reporting these in a Part 2 later in the month once I’ve gathered more data.

The second one is arenas, and this is purely down to me not being that great a PvPer and not being in a team. If I can amend the team bit (there’s no hope for me skill wise) then I’ll also try and capture some stats for them.

I’m also going to try and capture some data from playing transatlantic and using a US WoW account. While the data collected here will probably be fairly basic, it should help to amplify any differences for those playing on servers overseas.

In Conclusion

To sum up, I’m actually surprised by the results seen so far. I came into this being sceptical of the service and assuming it was some kind of scam. The results speak for themselves though – there’s clear evidence that the service does work and could clearly be a benefit to those suffering with poor connections. If you are suffering from lag issues then I suggest giving the trial a go and see if it fixes the issue for you.

In terms of cost, PingCraft offers LagKiller on a monthly subscription basis. The basic service comes in at $5.99 a month, while the advanced service (tested here) is $9.99 a month. Which one you’d want depends on your needs, with the advanced one offering more customisation options should you need them.

Look forward to Part Two later in the month, where I’ll be answering questions about raiding and cross-continent performance. In the meantime, feel free to hit me with any questions or thoughts in the comments section below.

Note: Mana Obscura was provided with free use of the service for the purpose of preparing this review.

Like this? Try these other related posts:

Tags: , , , , ,

10 Responses to Review: PingCraft LagKiller (Part 1)