Originally posted by beholder3 I said they tend to refocus for normal "resolution" tests which then look much better than real results, which do suffer from field curvature.
Refocussing between shots is lying to the audience.
Unless you are doing testing a better way, I don't really see the value of your criticism. Each of the testing sites has to make decisions on how to conduct their tests. Anyone who has doen any kind of testing realizes this. What is necessary is that the test be the same for all lenses.
While I would love to see more from lens rentals, as they are the only people with enough lenses, I generally find their charts to be pretty much unreadable. Photozone has a less complete way of showing data, but focuses on keeping it easily readable and understandable at a glance.
So, unless you are saying just ignore all test sites I'm not sure what you're saying.
The trouble with place like the forum is the skewed ratings based on what available at the time. Lenses the have no business being rated highly are, because at the time of release they were the best or close to the best out there. How does will the new 50 compare to the old ones?
For example the DFA 50 macro and 100 macro are rated over 9. I expect using the same scale the new 50 should be rated at least an 11. With no objective standards in place there will be simply no way to interpret how a lens 9.63 under 2015 standards compares tp a lens rated 9.63 in 2018 standards.
At least site like Photozone have held a lot of different lenses in their hands and have made the tests they feel are important.
I'm always bit mystified when folks criticize a site like Photozone, but really don't have a viable alternative. Surely part of that criticism should be pointers to who does it better.
Unless of course this list of critiques is to imply that all the work done by testers at Photozone and other test sites is worthless.
Just what are you saying here ?
I always say, the work of the test sites is limited and their weaknesses need to be understood, but they are still better than some guy who's handled 10 Pentax lenses in his whole life telling everyone about his personal preferences.