Some observations:
The GT31 with the latest firmware from Tom's site (www.mtbest.net) gives very small differences between trackpoint and doppler results. I have not had either of my Navis lock up since updating a few months ago. With the GT11, trackpoints almost always read higher. The most consistent results come from the doppler data of the GT31. The GT11 doppler data is also more consistent than its trackpoint data. Thats why doppler should be used if available. It helps keep the ranking clean.
By consistency, I mean the agreement between units exposed to the same conditions (eg worn at the same time). Thats what you need for a fair ranking. Manfred has done some great work compiling a lot of data to get some reasonable statistics on the consistency of devices, and differences between device types.
The only downside to this is that the guys with lower quality GPSs (eg garmin) will be scored with lower than their actual speeds more of the time. Whereas someone with a navi would have scores much closer (and therefore higher). So using a Navi would almost always (depending on confidence level selected) give you a better corrected score than a garmin worn on the very same arm at the same time. This is a result of applying a correction to meet a certain level of statistical confidence that the "corrected" speed is at or below the actual speed- with the correction based on collected statistics for that GPS type.
Unfortunately theres no way arround the lower resolution of the garmin. It sometimes reads a few knots higher, and sometimes lower. Same with the Navi, but not as often and not by as much.
So this begs a few questions:
1) will it make a big enough difference for anyone to care about? How serious are we, really? Do we care about a bit of noise/uncertainty in the ranking?
2) how much confidence would we need that the corrected speeds are at or below the actual speed? The more confidence we need, the bigger the penalty on garmin users.
3) will having a correction put off the garmin users, when they see their 2 sec speeds get slashed by a lot?
Technically its a sound idea, but practically theres a risk of losing some of our garmin users if they get upset at their 2 sec peak speeds being hacked. The other categories would be significantly less tweaked.
I think its a good idea if the garmin users endorse it- after all, they are the ones who would be most affected, and I dont think any of them are choosing garmins for the inflated peak speeds