To me, lens reviews are like a tool--it's all about how you use them. The best thing, I think, is to put little stock that one number, and rather to look at the detailed points made in the reviews. Certainly the ratings do diverge since everyone uses different standards, some rate against their hypothetical, ideal lens, others rate against an ideal lens of that focal length and aperture, others rate against their best lens (often a Limited or * lens), others rate in comparison to similar offerings in the focal length, others rate on price vs. performance, and of course yet others on some combination of these. What I find really helpful are reviews that go into detail about the optical qualities of the lens and the image in produces, particularly with some comparative reference. For seldom-seen lenses, samples are a boon too. There are really some fantastically helpful reviews in the database (an example would be Marc Sabatella's review of the M120), whose detailed descriptions, comparisons, and testing have made a difference to what I've purchased, and I try to write my own reviews to offer such guidance as well. So to me what makes a bad review is not someone who rates lower than others would, or even that notes how the nature of the lens is restrictive to their photography, but rather the person who gives an 8 rating, saying only 'had it for a few days now. Produces good pictures'. Also reviews that exist to try to influence pricing. The length and actual content of reviews betrays their own quality and reliability quite clearly, so I think the current system is fine (which does have a helpful button, and how many users found a review helpful is displayed under the username and user info, although it could certainly be in a more prominent place). For a while, the database did put those helpful reviews at the top, but the objection to this (which I raised) was that it made it very difficult (especially for more popular lenses) to find out when (and read) new reviews had come in.
As to the thought of giving more weight to the rating of helpful-voted reviews, again I think it something of a fool's errand to focus so much on the overall numerical rating. If PF were to do so, what would happen is that people would rate as helpful the reviews that gave the highest scores (so as to boost the rating of these their pet lenses), and therefore it would actually become harder to find truly helpful, informative reviews, not merely ones for which one agreed with the numerical rating.
Last edited by macTak; 09-09-2013 at 11:13 AM.