Wednesday, 25 April 2012

So why does my Garmin tell lies?

I have a Garmin Forerunner 305 and while for most things it's a splendid bit of kit, there is one bit of measurement that it's rather bad at.  Now if you're training to run long races, one of your key records will be the total distance you've run; for example I always feel reasonably confident if I've covered about a thousand miles before the first big event of the year, the West Highland Way Race. But if your races start to involve a lot of real hills, the quantity that becomes as important as your mileage and maybe even more so is the total height of ascent you have accumulated. Bob Graham Round aspirants will talk of needing to build up enough "10,000 ft weeks" and so on. And this is where the Garmin starts to go wrong; not just a little bit wrong but seriously wrong at times, sufficiently to question it's usefulness at all for recording height gain. This has bugged me for a year or two now so I set about trying to find out the reasons for the problem and what I could do about it.

While I hadn't bothered to gather any proper evidence, my feeling was that in hilly country the Garmin was overestimating the ascent a bit, but as the route becomes flatter the overestimation goes up substantially. I first looked at a couple of outings to see whether this was actually true.

Last Sunday I went for a walk in the Lakes, a slightly extended form of the Kentmere horseshoe but convenient for this exercise because I have the exact same walk in a guidebook, the author of which gives the total ascent for the round as 4400ft. It has quite a bit of up and down, but also some long stretches with gentle gradients once you are on the main ridge. My Garmin told me that the total ascent was around 4800ft. So, accurate to about 10%  - not great but in the ballpark.  The following day I went out for a steady six and a half mile run along a straight and level section of my local canal towpath; allowing for the odd thickness change in the footpath bed, maybe a total height gain of 10ft. The Garmin showed a total height gain of 724ft.  So here we have the issue.

I've found it very difficult to get any real information on how the Garmin works, but I've managed to piece together the following - any comments or additional gen would be most welcome!

First, there is an inaccuracy whenever the Garmin takes a height reading; I've found a few views on why this happens but I'm happy to just put it down to "the system". It makes small errors all the time and larger errors less frequently. If I look at the elevation trace of my canal run it's very noisy but most of the variation is within +/-15ft though there are occasional peaks and troughs at +/-50ft. The trace of my Kentmere walk was much smoother and enabled me to compare the map height at each top with the height recorded by the Garmin, which gave the following comparison:

Top                        Map Height       Garmin Height     Error
Yoke                      2316                 2321                     +5
Ill Bell                     2483                 2491                     +8
Froswick                2360                 2394                     +34
Thornthwaite Crag  2572                 2570                     -2
Gray Crag              2293                 2233                     -60
High St                   2718                 2728                     +10
Mardale Ill Bell       2496                 2525                     +29
Harter Fell              2552                 2588                     +36
Kentmere Pike        2396                 2423                     +27
Shipman Knotts      1926                 1958                      +32

So again, not very scientific but you can see the spread of accuracy, similar to that on the flat.

But secondly we have to think about when the Garmin takes the readings and what it then does with them.

On a Forerunner 305 there are two modes of data capture. Mode 1 collects and processes a set of data once per second. A lot of data in a short time, useful for downhill ski-ing, mountain biking, and maybe runners doing sprint sessions but too much for distance runners, especially as in this mode the data store is full in 3,5 hours. Most ultra runners will have the Garmin set to Mode 2, which is called "smart" capture. A simple interpretation of this is that it collects and processes a new set of data when it sees that something has changed - direction, speed, etc.

When it constructs a trace for any parameter over time  -  position, height, heart rate, etc - the Garmin then applies a "smoothing" algorithm so you see the trend rather than the noise of all the individual readings. This works better for some parameters than for others, for example position (ie the "map" track) and heart rate are quite smooth, whereas pace is always quite noisy.  Height ("elevation" in Garmin-speak) seems to be noisy for flat courses and much smoother for hilly ones.

It's easy enough to see where the over-estimation of height gain comes from, look at the sketch below:

 







This shows the elevation of a track. The blue line shows a runner progressing along a level course A-B-C-D. The red line shows the Garmin interpretation of the elevation it thinks the runner is at. It underestimates at A, overestimates at B, and so on. So unless the red line is completely smoothed by the algorithm to match the blue one, the Garmin will record height gains from A to B, and from C to D, where in reality there are none. This is a gross simplification, but it shows the problem. Now imagine that the runner is actually going uphill, as below:











Again there are errors in the Garmin elevation record, but because there is now an actual height gain, the degree of over-prediction will be less. Again a huge simplification, but you get the point. So it will be easier for the algorithm to smooth the trace if there are actual elevation changes than if there are none, and I could surmise that the steeper the route, the more accurate the Garmin will get, which seems to agree with what I find in practice.

So where has this little exercise got us?

Well, if you're still with me, I think I've convinced myself that
1. Garmin "height gain" is inaccurate because there is an inaccuracy in the initial readings.
2. The system is able to compensate better for the inaccuracies as the course gets hillier
3. There seems to be some sort of semi-logical explanation for this.

What I don't have is any way of applying a correction that will work consistently, even an empirical one. For example, I suspect that the inaccuracy would be different on a continuously up and down course than on one with the same overall height gain comprising one big hill and flat for the rest of the route.
 
What I do seem to find looking back over quite a few records is that if the outing shows a Garmin height change overall of around 300ft per mile, then the record starts to look believable. Below that, I think the errors are significant and I don't think I'll bother with them.

Any comments or contributions welcome!














Tuesday, 17 April 2012

Wandering with AW

Rainbow over Martindale
As my regular reader will know I haven't been doing a lot of running lately. Actually I've just started again, which has now presented me with the interesting problem of how to make up for missing the best part of four weeks then fitting in a taper before the Highland Fling in two weeks time. Well. no-one said this game was supposed to be easy.

But in the meantime I felt I should get out a bit, and while any movement involving sudden deceleration (like a foot hitting the ground every running stride) brought with it some incentive not to try a repeat, I could walk more or less OK. My main adventure for this year is the Tor des Geants in September, which basically consists of walking up a lot of big hills, so I thought it wouldn't hurt to start early and get some uphill practice in the bag. But where to go? My biggest local hill is Snowdon and while it's a fine peak I feel I have some personal acquaintance with almost every rock on the main paths by now. No, I would go back to the Lakes, which apart from the Lakeland 100 route and the odd day Bob Graham wondering (no, not a typo) I know much less well.

Start walking in the Lakes and you immediately run up against AW. Not many folk are immediately recognised by their initials alone, but Alfred Wainwright's "Pictorial Guide to the Lakeland Fells" must be known to anyone who ever pulled on a pair of boots. So much so that the 214 tops detailed in his series of hand written and illustrated books are now known simply as "The Wainwrights", a list to sit alongside the Munros, Corbetts, Nuttalls, and so on, and collecting the Wainwrights is a pastime to which many Lakeland wanderers devote a fair amount of time. Jan and I know several people with pieds a terre in Cumbria who are devotees, including one couple who having completed the set a time or two are now setting about revisiting them in alphabetical order; retirement affects us all in different ways.

Now I've never been one for ticking off lists but I guess you know what's coming. I decided the best way to get to know the Lakes better and do a bit of uphill training at the same time would be to have a tilt at the Wainwrights. To put the thing in perspective, this is not like setting out on the Munros. Joss Naylor once visited every top within a long, long week, but by any measure he was (and still is) a pretty handy performer and if you read the accounts he was a bit tired when he finished. A calendar year, or maybe a summer, might be a more sensible objective.

So I bought my "Wainwright Map" and got started. In five day trips so far I've clocked up 55 tops. The low hanging fruit is always the easiest of course and the thing will get harder, but the days are longer now and maybe I'll even get a bit fitter. And part of the fun is the evening spent before any trip trying to work out an interesting route over a reasonable number of hills. I was surprised to find when I started that over the years I had already climbed around 60, so I set a simple rule for this year. Any top that I have not visited before I would make sure that I did on a day when I could see the view, which left me this 60 "in reserve" for days of mist and low cloud.

Wainwright Map


What I've found already is a lot of pleasure in going to places I would never have considered. Sitting alone on the splendid summit of Cold Pike watching the crowds on the Crinkle Crags to Pike o' Blisco motorway; lunch on the warm springy grass on top of The Nab under a blue sky, and a dozen other memories already.

Will I see it through this summer? I hope and think so, once I've embarked on something I don't give up so easily. But I'll have to get back to a bit of proper running again now. Watch this space.