Originally posted by AfterPentax I understand that position you take, but these reviews or tests are worthless in my opinion.
... and yet, like me, you've posted lens reviews on PentaxForums for others to read... which leads me to wonder why your lens reviews (or mine) might be worthy of attention and those of DxOMark and others are worthless.
Originally posted by AfterPentax The only thing that is important is how one experiences in this case the DA 21mm.
I agree that it's our individual experience of a lens that
ultimately matters, and reviews can't take our subjective assessments into account. However, well-defined and controlled bench tests from reputable review sites ("reputable" being the key word here)
can measure what a lens is
technically capable of, and this can help to inform a buying decision. Such measurements are no guarantee that we'll
like a particular lens, but if our own results don't broadly match those of the reviews in terms of basic performance, we might reasonably suspect that we bought a dud or perhaps we're doing something wrong (e.g. using the wrong AF mode for our use case, or the wrong aperture for our required depth of field), or not doing something at all (e.g. correct AF fine adjustment). That in itself is useful.
Originally posted by AfterPentax And there are a lot of camera's you can attach this lens to, but the results you get are they really because of the lens being better, or has it to do with the camera the lens is attached to.
If you look at
DxOMark's comparison of the SMC and HD DA21, they used the K-3 for both. Actually, they performed the same tests using a variety of Pentax bodies with both lenses, and provided the data for all of them. The results in every case showed the HD performing slightly better in certain respects, though the differences are such that any benefit should be marginal and largely subjective in most situations.
I realise some reviewers use opaque, questionable or inconsistent approaches in testing, but not all review sites are made equal. Some really are worthy of our consideration, and where lenses are concerned I find DxOMark to be a pretty dependable resource, so far as it goes. There are several others of note, and in my experience it's best to look at a number of them to aggregate findings and filter any anomalies due to errors, sample variation etc.
Originally posted by AfterPentax I do not believe in these tests because it is just a snapshot (pardon the pun). The only thing that counts for me is how I experience the lens (or camera) and if the outcome is what I saw when taking the picture. You experience the 21mm a cracking lens, I did not know how fast to return it. With all those reviews it is a personal experience with a combination of lens, camera and a certain photographer that gives a result, but as I am not that certain photographer, with my camera and the same lens the result can be very different.
Again, I'll say that not all review sites and not all reviews are made equal. Personally, I consider aggregated and filtered findings from multiple reputable sources to be a fairly reliable starting point when choosing lenses... and whilst I have neither the equipment and software nor the inclination to repeat their controlled test-bench measurements, my real-world shooting experience of lenses I've bought (the HD DA21 included) has generally matched review findings. Still, some of those lenses - despite performing as the reviews suggested - aren't favourites of mine due to one or more aspects the reviews didn't pick up on, or simply my own tolerances or rendering tastes... which proves your point that it's the way we each experience a lens that matters most.
If your experience with a specific lens is such that the technical performance aspects don't appear to match the majority of reputable review findings, there comes a point where you have to seriously consider
why that might be, rather than concluding all reviews are worthless and/or that model of lens isn't very good