Forgot Password
Pentax Camera Forums Home
 

Reply
Show Printable Version Search this Thread
01-25-2017, 11:31 AM - 3 Likes   #1
Veteran Member
MJSfoto1956's Avatar

Join Date: Dec 2013
Location: Boston
Posts: 1,289
Unhappy with DxOmark...

So a year ago, DxOmark reviewed the K-1 and gave it an excellent score of 96, putting it in the top 5 best full-frame cameras ever.
However a year later, they have yet to publish the data on the K-1 + Pentax lenses. Note that they have the data as the K-1 is fully supported with DxO Optics Pro v11. Wish they would get off their backsides...

Attached Images
 

Last edited by BigMackCam; 01-25-2017 at 12:48 PM.
01-25-2017, 12:05 PM - 1 Like   #2
Emperor and Senpai
Loyal Site Supporter
VoiceOfReason's Avatar

Join Date: Jun 2010
Location: Mishawaka IN area
Photos: Albums
Posts: 5,955
They have also been hiding the 645z results for some time. They made a mistake and published them once on accident.
01-25-2017, 12:08 PM   #3
Moderator
Site Supporter
Loyal Site Supporter
MarkJerling's Avatar

Join Date: May 2012
Location: Wairarapa, New Zealand
Photos: Gallery | Albums
Posts: 12,805
Indeed! The leaked 645Z results. 101! See https://www.pentaxforums.com/articles/photo-industry-news/pentax-645z-ranked...y-dxomark.html https://www.dxomark.com/Cameras/Pentax/645Z and Pentax 645z scored 101 at DxOMark? | Pentax Rumors
01-25-2017, 01:39 PM   #4
Veteran Member




Join Date: Sep 2013
Photos: Gallery
Posts: 1,743
They've gotta be doing this on purpose, but... why?

01-25-2017, 02:05 PM   #5
Site Supporter
Site Supporter
luftfluss's Avatar

Join Date: Jun 2011
Location: NJ
Photos: Gallery | Albums
Posts: 6,799
It's rigged.
01-25-2017, 02:20 PM   #6
Moderator
Site Supporter
Loyal Site Supporter
MarkJerling's Avatar

Join Date: May 2012
Location: Wairarapa, New Zealand
Photos: Gallery | Albums
Posts: 12,805
QuoteOriginally posted by lithedreamer Quote
They've gotta be doing this on purpose, but... why?
There's been lots of theories why, but no response has ever been forthcoming from DXOmark.
01-25-2017, 02:21 PM   #7
Veteran Member




Join Date: Aug 2014
Location: Italia
Photos: Albums
Posts: 354
Hmmm... there's not a single Fujifilm camera test on dxomark....hmmmm... Why so???!!!! Aren't the Fuji lenses good enough to be tested?
01-25-2017, 02:24 PM   #8
Pentaxian




Join Date: Jan 2015
Location: mid nth coast,nsw
Photos: Gallery
Posts: 4,426
QuoteOriginally posted by bm75 Quote
Aren't the Fuji lenses good enough to be tested?
They are too good!

01-25-2017, 02:36 PM   #9
Veteran Member




Join Date: Aug 2014
Location: Italia
Photos: Albums
Posts: 354
Exactly !! why the hell a APSC lens would resolve so much lpmm on a 16 mpx sensor when Dxo states that the more the resolution, the more the sharpness and consequently the biggest dxo scores (thus FF being the best)?

that said, they have a scientific basis in their tests, so I don't want to be unfair towards them.
01-25-2017, 02:42 PM - 3 Likes   #10
Pentaxian
tvdtvdtvd's Avatar

Join Date: Jan 2010
Posts: 1,569
I think the bigger mystery is why anyone still pays attention to DxO. Their bias is obvious, so why even bother.
01-25-2017, 03:47 PM   #11
Pentaxian
Na Horuk's Avatar

Join Date: Feb 2012
Location: Slovenia, probably
Photos: Gallery | Albums
Posts: 11,183
QuoteOriginally posted by bm75 Quote
that said, they have a scientific basis in their tests, so I don't want to be unfair towards them.
Many faults, though.
a) They don't publish exactly how they do the tests. Tests could be faulty, are unverified, have not been reproduced, and we don't know how many lenses they used for each test (because of sample variation, this could be a significant problem).
b) They test lenses on various cameras, which means you cannot compare the lenses between different cameras (not even from the same brand or with same sensor). Even if you look at the same lens tested on K-5 and K-3II, there are differences - and not just the ones you would expect. One lens gets much better, another only a little better, some get worse.. its weird. They should test lenses on an independent sensor (or extremely high resolution film - these do exist) so we could then compare lenses across brands. This should be fairly simple and everyone could reproduce the test
c) Same thing for camera tests - they get tested with some lenses, but I am not sure they use the same exact ultra high resolution lens for all camera tests, which would be required for objective camera comparisons. Some cameras get tested in special hires modes, but others don't. Some cameras have NR and sharpening built-in into the "raw", which also skews results.
d) Finally, not reviewing lenses on K-1, not publishing 645Z results (despite doing the test!), not using Pixel shift mode correctly with the K-1 review (but they do use advanced features like PS when testing their own camera!),... either these are big blunders, or purposeful bias. I don't know why, but I assume its because Pentax doesn't have a big budget to pay for adverts and positive reviews (unlike Nikon, Sony, and Canon)

When looking for lens info, I look at other websites, as well. LensTip, Photozone,.. and user reviews on this forum. You can find sample photos on 500px, Flickr, in threads here.. relying purely on some numbers from DXo is a bad choice

Last edited by Na Horuk; 01-25-2017 at 03:52 PM.
01-25-2017, 04:07 PM   #12
Veteran Member




Join Date: Aug 2014
Location: Italia
Photos: Albums
Posts: 354
There are some repetitive patterns, though. I suppose their lens evalueting system is strongly affected by f/stop number: this thing itself means that , from the biginning they consider a f/4 lens just worse than a f/2.8 one (not exactly what describes the character of a lens, in my opinion...). Then the mpx count is obviously of critical importance for them: the same lens performs from 12 to 27 depending on the camera used (typically 12 on 12 mpx APSC , 27 on 36mpx FF - Nikon system ) . Those results are repetitive: 16 mpx k5 and d7000, sharing the same sensor, will affect lenses test in the same way - typically scores not exceeding 18, no matter the brand. Same lens, different sensor, no matter the brand, performs better on FF. You'll recognize some lenses they consider crappy because the difference between tests at 24 mpx and 36 mpx are of minus difference, thus involving the lens not being able to perform correctly at 36 mpx.
I think that there could be some scientific method basis.

---------- Post added 01-26-17 at 12:14 AM ----------

QuoteOriginally posted by Na Horuk Quote
When looking for lens info, I look at other websites, as well. LensTip, Photozone,.. and user reviews on this forum. You can find sample photos on 500px, Flickr, in threads here.. relying purely on some numbers from DXo is a bad choice
You're right. I do the same but I find Dxom Iso tests quite credible. For sure they give just numbers and their results have to be taken "cum grano salis".
01-25-2017, 04:30 PM   #13
Pentaxian
Na Horuk's Avatar

Join Date: Feb 2012
Location: Slovenia, probably
Photos: Gallery | Albums
Posts: 11,183
I think I really lost faith in DXo some time ago when I was looking at DA 40mm reviews. What really confused me is the SMC DA 40mm, DA 40mm XS, and HD DA 40mm. The order of best to worst of these three is different when tested on K-5 and K-3. Even though they have really similar, if not identical, optics (the HD has newer coatings, plus it has rounded blades)
01-25-2017, 04:37 PM   #14
Veteran Member




Join Date: Aug 2014
Location: Italia
Photos: Albums
Posts: 354
We must remember that those kind of tests are not conducted "in the field", with real subjects ,but in a laboratory (we hope ) under controlled conditions. Real world testing is something different and surprises are just round the corner. in my opinion lenses perform always better in the field than in the laboratory.
01-25-2017, 05:03 PM   #15
Site Supporter
Site Supporter
Digitalis's Avatar

Join Date: Mar 2009
Location: Adelaide.
Posts: 9,923
QuoteOriginally posted by bm75 Quote
they have a scientific basis in their tests
They don't. They have only partially published their testing methodology and it is rather questionable. They should allow users to have access to their raw data, even if it only to paying members.
Reply

Bookmarks
  • Submit Thread to Facebook Facebook
  • Submit Thread to Twitter Twitter
  • Submit Thread to Digg Digg
Tags - Make this thread easier to find by adding keywords to it!
data, dslr, ff, full frame, full-frame, k-1, k1, lens, lenses, matter, pentax k-1, results, sensor, tests
Thread Tools Search this Thread
Search this Thread:

Advanced Search


Similar Threads
Thread Thread Starter Forum Replies Last Post
Unhappy with K-30 BANKatBULL Troubleshooting and Beginner Help 86 06-06-2017 05:13 PM
Unhappy with my Tamron 28-75 f2.8 ChopperCharles Pentax SLR Lens Discussion 28 11-09-2011 06:43 PM
Still unhappy with k-7 focusing rainbowrider Pentax DSLR Discussion 6 05-08-2010 02:43 PM
Dealing with unhappy customers Eigengrau Photographic Technique 42 04-30-2010 05:56 PM
Spoiled by old SMC glass! Unhappy with new zoom. JasonS Pentax SLR Lens Discussion 28 10-01-2007 12:24 AM



All times are GMT -7. The time now is 10:53 AM. | See also: NikonForums.com, CanonForums.com part of our network of photo forums!
  • Red (Default)
  • Green
  • Gray
  • Dark
  • Dark Yellow
  • Dark Blue
  • Old Red
  • Old Green
  • Old Gray
  • Dial-Up Style
Hello! It's great to see you back on the forum! Have you considered joining the community?
register
Creating a FREE ACCOUNT takes under a minute, removes ads, and lets you post! [Dismiss]
Top