Originally posted by bdery "Doing science" is a pretty vague concept.
Applying the scientific method is easier to demonstrate, indeed.
When reviewing, I try to be methodical, transparent, use a repeatable list of test and testing conditions, control my variables, make hypothesis but let the data speak and avoid, as much as possible, bias.
Doing Science is as accurate a term as is required, as long as one is willing to put fixed definitions to words.
The thing with doing science is that it implies scientific methods, and that means when comparing two things, only one variable gets changed at a time.
Even then, it’s hard.
When I compared the FA50/1.4 to the D FA*50/1.4 I missed focus on one of the lenses by a couple of millimetres. Normally I’m pretty good about this stuff, I’ve been doing science since I was 13.
Anyway, I was off by enough to render an absolutely direct comparison impossible, and so results needed to be somewhat extrapolated. It didn’t take away from the fact the new lens was a couple of football fields better than the old one, the results were good enough for that, but I would have liked to have done better.
When someone is comparing, for example, a Tamron 70-210/4 On a Nikon to a similar Pentax 70-210 on a Pentax, there is no “doing science” going on, there is just some dude in his backyard playing with cameras, and a lot of make believe. It’s the very definition of “fake news”.