Originally posted by monochrome @Carey Rose:
The DPR posts have been pretty fair and accurate recently. It is kind of their reviewer to JOIN the Forum (New Member) and post in one of our threads, so we can understand the process he used (and know he understands the shortcomings). It's particularly refreshing that one of our members reached out to him to explain a fine detail of the Pentax files and jpeg conversions - and the writer actually reprocessed the images and re-posted them. That is, I think, unprecedented. In all my time on these fora . . . .
The over-rating in the Review database has been discussed often over the years, from many perspectives. The way to use the ratings is to accept the standard here is different than an independent database, then compare the rating of a reference lens that you own yourself to the ratings of the other lenses.
The absolute rating number doesn't matter - it is just an index. What matters is the relative rating of each lens, when compared to the others. So an M28/2 at 9.33 is clearly preferred over an M28/2.8 at 8.22. And a K28/2 at 9.69 is preferred to the M28/2 at 9.33. And a K28/3.5 at 9.31 is about equivalent to the M28/2 at 9.33. I own all four of those lenses. The relative ratings accurately describe the relative attractiveness of these 4 28's. The absolute numbers don't really matter.
Secondly, we all know in a non-scientific, open, subjective rating system, one poster with a curly hair in his . . . Is perfectly free to rate a lens 1 or 2, bringing down the average number. As a matter of habit I throw out the highest and lowest rating and calculate my own average number.
Thirdly, the number itself doesn't matter one whit. What matters is the comments the poster makes, and any sample images the poster uploads.
I hope these observations ease your tension and make your evening a bit more pleasant.
Courtesy and common sense on a discussion forum??
I suspect that a lot of people, DPR reviewers or not, may be joining or at least reading our forum over the next few months. Most of them will be far more familiar with the workings and peculiarities of other systems than they are with those of Pentax and I hope they find this forum a pleasant and informative place.
As for the DPR article and the lens reviews, I think most people would learn a great deal by paying more attention to this kind of article (which doesn't attempt to put a star rating on everything) and the comments in the reviews, rather than focusing on numbers (especially ones which are based on opinion). Our desire to put a rating on everything and ignore everything else causes a lot of problems.
Having said that, and aware that I'm going against what I just said (to some degree), with the lens reviews I generally regard a seven as a zero, meaning anything less than that is not worth owning (for me). If I'm out and find a lens for sale and want a quick check to see if it may be worthwhile buying then this is the first thing I assess, But I'll read the comments to look for specific pluses and minuses and to spot users who I suspect aren't using the lens/camera correctly, are being unreasonable in their assessment or who appear to have had the bad luck to get a bad copy.
Something about the DPR coverage in general (though not in this article) of the K-1 that I don't like is the repeated statement that it is really only for existing Pentax users and won't tempt people away from other systems. I know Ricoh themselves have stated as much but it's obviously untrue - a company which doesn't want to expand it's user base? Come on. It's something which has punctuated Pentax reviews on DPR for many years, long before the K-1 came along, and has always seemed at odds with the generally good impressions of the gear. Many Pentax reviews or articles state how nice a product is but then comes the unjustified disclaimer "but of course it won't make people switch systems". This re-inforces the impression that DPR is in the pocket of the big two, an impression that I think has diminished over the last couple of years due to their interest in mirrorless formats and their recognition that they are the future, but in the case of Pentax this attitude persists.