For some reason, a number of people have jumped on the " this is a bad lens" bandwagon. Personally I think it's affected the reviews. There are two kinds of people. Those who use the lens, who find that the supposed "limitations" are pretty much imaginary. And those who don't use the lens, many of whom are upset with it's price, because they haven't really looked at the numbers or used it. In the very review I linked to the reviewer complains about the lens and rates it 1.5 out 5 and warns people to stay away from it. The man clearly didn't understand the meaning of his own numbers. Ever since he posted the review it's been a refrain on this site.
People are sheep sometimes, people have unrealistic expectations sometimes. I've read through the lens section where every person raves about a given lens, and then one guy who probably was clinically depressed when he wrote the report just trashes the lens and marks it way down. And that affects the numbers that get posted for the lens. So what's unfair about that? The guy doesn't own every lens. He only trashes the lenses he owns. So every lens he writes about takes a hit in the database rating, and every one he doesn't own gets a free pass. You can't run a user rating system, and then start picking and choosing which guys you're going let post. Even though some may be using the lens rating system as therapy rather than information sharing.
Quote: Yeah, you can't look at user scores (or even in-depth review scores) alone. Here are some comparative shots:
The test images Adam posted were actually critical to my buying the lens in the first place. Numbers are wonderful, but you really don't know what they mean until you see some side by side images.
I'm not sure there's anything Adam can do about that. I've thought about it, and any solution I can come up with involves a lot of work for someone. I'm not willing to propose that on a site run by volunteers, you could find anyone willing to take that on. It would be a thankless task that went on for ever, and the moderation would present just as many problems as it would solve. I've often pointed out that unwarranted criticism is a problem on the site. We are the most pro Pentax site anywhere, but at the same time we are also the most anti-Pentax site anywhere. There could be a solution to that, but the solution is probably worse than the problem.