Originally posted by pres589 Someone recently posted a 50mm test using a bunch of older lenses, I think all of them were f1.4 or 1.7 max aperture jobs. Wasn't a blind "taste test" like Norm organized previously. If Norm were to actually round up some 50's, I'd hope that he would include the DA 50 1.8, just to toss in a cheap modern alternative. I'm sure he appreciates me suggesting more work for him to do for the good of the cause (tongue in cheek joke, as apparently I'm not always clear when I'm being funny)
I do my best, but there's a limit to what I can accomplish. The day we shot the 35s, there was something going on with my Sigma 17-50, it simply wouldn't focus. It's never happened before or since, I have no idea what was going on. As a result it did poorly. If I were a professional tester, I would have reshot that test. But I'm just a guy. My tests will never be good enough for the picky folks, but quite often they confirm what I see, and let me know that it's not just me. Others see what i see. That being said, I know the testers at Imaging Resources go through the same types of issue and post comparative issues with problems like using different focal points etc. or needing many tests to produce the maximum image possible with a lens. They got a terrific D800 test when it first came out, but they admitted afterwards, it took them 7 tries to get it. So in a way it was a total misrepresentation. They showed the best image, but if they'd gone with what camera will give you the best image in one attempt, it wouldn't have been the D800.
In my tests, I get two points in focus, that are in focus on every image and I shoot each lens until I get those, sometimes manually focussing. IN another 35mm test, the SMC M 35 3.5 was the clear winner. but it took 20 exposures to get the winning shot, while other lenses produced their best image on the first shot, with no other lens taking more than 5 shots to get the two points I wanted in focus nice and sharp. So, winner or loser? It depends on how you define winning and losing.
Unfortunately, the more you know about a test, the more you understand it's limitations. And you always end up questioning, if you're not getting paid, if it was worth doing it. That test I referred to above was a complete disservice to the Tamron 17-50, but it also makes a valuable point.
I guess what I'm saying is, testing isn't as rewarding as you might suspect. A good test always makes you want to do a better test.
It's like hitting yourself in the head with a hammer. It feels so good when you're done.