Wednesday, July 06, 2005

Pay-To-Play In the Spam Filter Ratings Game

My company, CMS, recently received an offer from a respected magazine to add our product, Praetor, to an antispam report that will, as they put it “feature a detailed technical analysis on the performance of a number of the world's leading products and services”.

Sounds great doesn’t it? CMS is confident that Praetor would measure up well against any list of antispam products and filtering technologies.

The catch… It costs $14,000 to join this club. Pay-to-Play or watch the game from the other side of the fence hardly seems objective and thorough.

Using an analogy based upon the auto industry...

Suppose a major automotive magazine offered the same deal, $14,000 to test your model of car. Then suppose that the only cars submitted were “Yugos” and “Ladas”.

The report would then create a ranking based upon a very small sampling. BMW, no mention. Cadillac, no mention. Ferrari, no mention. Get the drift?

Rankings are fun and I must admit I do like "top 10" lists but be sure the sample is large enough to get a true, unbiased picture.

Incidentally, in defense of the Lada, I spent many hours in them during my trips to Russia. While cramped, they always got me where I was going in a utilitarian but definitely not luxurious manner.

AAS

0 Comments:

Post a Comment

<< Home