The Verge’s Review Scale
Re: my postscript wondering how in the world David Pierce’s scathing review of the Humane AI Pin resulted in a 4/10 score — I didn’t realize that The Verge has a page describing their review scale:
We assume the 10-point scale is relatively straightforward, but
below is a short guide as to how we view the numbers. All review
scores are whole points. We no longer use half points or decimals
when scoring a product.
Utter garbage and an embarrassment.
A product that should be avoided at all costs.
Bad — not something we’d recommend.
Mediocre — has multiple outstanding issues.
Just okay. This product works well in some areas but likely
has significant issues in others.
Good. There are issues but also redeeming qualities.
Very good. A solid product with some flaws.
Excellent. A superb product with minor or very few flaws.
Nearly perfect.
The best of the best.
Those are great descriptions and that’s a useful 10-point scale! But by these guidelines, the AI Pin should have gotten a 2. Maybe a 3, tops, but I’d say “should be avoided at all costs” fits. Definitely far short of 4’s “mediocre”.
But this isn’t the first time I’ve found The Verge’s review scoring incoherent.
★
Re: my postscript wondering how in the world David Pierce’s scathing review of the Humane AI Pin resulted in a 4/10 score — I didn’t realize that The Verge has a page describing their review scale:
We assume the 10-point scale is relatively straightforward, but
below is a short guide as to how we view the numbers. All review
scores are whole points. We no longer use half points or decimals
when scoring a product.
Utter garbage and an embarrassment.
A product that should be avoided at all costs.
Bad — not something we’d recommend.
Mediocre — has multiple outstanding issues.
Just okay. This product works well in some areas but likely
has significant issues in others.
Good. There are issues but also redeeming qualities.
Very good. A solid product with some flaws.
Excellent. A superb product with minor or very few flaws.
Nearly perfect.
The best of the best.
Those are great descriptions and that’s a useful 10-point scale! But by these guidelines, the AI Pin should have gotten a 2. Maybe a 3, tops, but I’d say “should be avoided at all costs” fits. Definitely far short of 4’s “mediocre”.
But this isn’t the first time I’ve found The Verge’s review scoring incoherent.