Originally posted by bdery I agree with your first sentence, which means I disagree with the second. The points system is informative, but like everything else, it has limits. For instance, if a lens is rated excellent by everyone, it's interesting to go and read why one person rated it as poor.
That's fair, but I stand by my original statement
Why? Let's say a lens is given a 10/10 rating by one of our members in their user review. That could be for so many reasons, including:
- it's a genuinely stellar performer (indeed, it would have to be the very best performer, or how could the reviewer accurately rate the next lens they buy... especially if it's better!
)
- it's much, much better than expected for the $500 paid... but compared to a $2,000 Zeiss, it may well be unexceptional, so does it still deserve the 10 rating? If so, how do we use the ratings to choose between the $500 and $5000 lens?
- it's the best lens the reviewer has ever owned... but in fact there many other, better lenses that they haven't used yet, so their reference points for ratings aren't complete
- everyone else seems to say it's a great lens, so the reviewer convinces himself that it must be as good as everyone else says and joins the club of happy owners
- the reviewer has paid a lot of money for the lens, so he convinces himself it's the best in order to feel good about the purchase
- the lens may be great for certain types of shot - portraiture, for instance - and achieved the rating because that's how the reviewer uses it... but when used for landscape - capturing distant detail - it's not so good
- etc. etc.
And there are many reasons why someone may give a really poor rating for a lens, including:
- the reviewer got a dud copy
- the reviewer doesn't understand the strengths and weaknesses of the lens, and how to get the best from it
- the reviewer generally shoots "better" lenses, and whilst the reviewed lens may be perfectly decent, he's rating it compared to his stock of high end glass
- the reviewer has seen photos taken by better photographers using cheaper lenses, and is unable to get such results from his more expensive lens (the fault of the reviewer)
- the reviewer hasn't adjusted AF fine focus accurately
- the reviewer hasn't taken into account focus shifting and field curvature, which may be perfectly normal for the lens question
- etc. etc.
If I see a lens with lots of 9 or 10/10 ratings, I take it with a large pinch of salt (it might, however, prompt me to look at a number of more formal reviews, such as yours and those from Photozone, LensTip, DXOMark etc.).
Detailed review commentary, however, helps me understand the reviewer's level of experience, what they expected, what they like / don't like and why. So, I tend to find that much more indicative of true performance than the numerical ratings