Originally posted by glanglois If a review were not subjective, it would be a bare bones spec sheet. Reviewers, and the rest of us, come with a point of view. We call it "bias" if we don't like it.
But it *is* bias if we know the point of view is not true (or the complete truth).
Quote: There are two real issues:
Can we tell what the POV is?
Is the POV consistent from review to review?
If we can answer yes to the first, perhaps we can calibrate for it. Think "Ken Rockwell". I'll apply my POV to his POV and see what happens. Not a problem. If the reviewer tries to conceal a POV, we have an unprofessional reviewer. Bad news.
If we have to answer no to the second, everyone has a real problem. No way to calibrate. Now we have an unprofessional reviewer.
And that's where editorial supervision comes into play. Subjective may be OK. False claims of objectivity and lack of consistency are not OK.
Fine reason to drop the publisher a note and ask for openness and consistency. Objectivity is probably asking too much.
Did this make any sense at all???
Yes.
Reviewing photographic gear is subjective even if we have the best quantitative measures of quality in each aspect of testing equipment. Standardising the subjective tests is definitely the best way to get consistency in reviews.
Editorial boards are good - but each magazine/group have their own opinions about what matters in a camera, so there will still be significant subjectivity.
Add to that allegiances to Canikon for whatever reason - sponsorship, personal preference and peer influences - and you have a complicated recipe for bias...