Forgot Password
Pentax Camera Forums Home
 

Reply
Show Printable Version Search this Thread
03-21-2011, 07:20 PM   #76
Banned




Join Date: Nov 2010
Location: Williston, VT
Posts: 268
QuoteOriginally posted by Christine Tham Quote
That can't be true, since the camera can process images (at 7fps) faster than it can write out - this is true for most cameras, where the camera can achieve a higher write speed in JPEG only compared to RAW, so the write speed is constrained by how fast the camera can write out the raw buffer.
That makes no sense at all. The camera isn't processing images at 7fps, it's just evaluating the scene at 7fps. The stream of data from the sensor just gets piled (unprocessed) into the buffer until the buffer fills up. Once the first image has been streamed into the buffer, the so-called "PRIME II" engine then starts processing this data as fast as it can, which is not necessarily anywhere near the theoretical write speed of the SD bus. By your standards, the K-7 (which used the exact same buffer and processing engine) should've been able to maintain 3fps indefinitely since it generated smaller RAW files. It could not. Not even close.

I just benchmarked my SanDisk Extreme Pro card in a USB 2.0 SDHC card reader. Real life write speed was 33.0 MB/s. This card reader is very old, it was "new" back when SDHC was "new", one of the first SDHC-capable card readers on the market. That's a far, far cry from both the 25 MB/s you quote, or the 17.5 MB/s claimed by the K-5. Clearly the card is capable of a lot more speed, even without UHS-1. Therefore the bottleneck lies elsewhere.

By the way, have you tried this experiment with just JPG files? I get 33 beautiful black pictures before the buffer fills up, totaling 129MB... and it takes 10 seconds to write them. That's barely 13 MB/s. Clearly the bottleneck is elsewhere inside the camera. It's not SD card write speed.

03-21-2011, 07:22 PM   #77
Banned




Join Date: Nov 2010
Location: Williston, VT
Posts: 268
QuoteOriginally posted by Christine Tham Quote
Since we can assume the K10D has a slower processor than the K-5 (much slower fps, despite smaller image size) clearly the image processing speed is not a factor in the K-5 write performance.
That's an odd assumption. The K-7 and K-5 both have exactly the same processor specs. There's no reason to assume that either of them are vastly superior to the K20D or K10D. It's more likely that the K10D produces smaller images which require less processing, thereby freeing up the processing engine to push more data to the SD card.
03-21-2011, 07:33 PM   #78
Banned




Join Date: Nov 2010
Location: Williston, VT
Posts: 268
More proof that the bottleneck is the image processing engine:

I just took 36 RAW+ pictures (72 total files) at 1.5fps (that's how many shots it took to fill up the buffer). These were REAL pictures, no lens cap. I was using REAL exposure settings taking actual pictures of stuff around me as I held the shutter down. The SD card light was on the whole time. The camera wrote 944 MB to the SD card in 40 seconds. That's 23.6 MB/s.

...and this is why your testing methodology and conclusions make no sense.

edit: oops, make that 39 seconds. I forgot the camera doesn't start writing until 1 second into the burst. So make that 24MB/s.

Last edited by Hound Tooth; 03-21-2011 at 07:43 PM.
03-21-2011, 07:45 PM   #79
Veteran Member
Christine Tham's Avatar

Join Date: Nov 2008
Location: Sydney, Australia
Photos: Gallery
Posts: 2,269
Original Poster
QuoteOriginally posted by Hound Tooth Quote
That makes no sense at all. The camera isn't processing images at 7fps, it's just evaluating the scene at 7fps. The stream of data from the sensor just gets piled (unprocessed) into the buffer until the buffer fills up. Once the first image has been streamed into the buffer, the so-called "PRIME II" engine then starts processing this data as fast as it can, which is not necessarily anywhere near the theoretical write speed of the SD bus. By your standards, the K-7 (which used the exact same buffer and processing engine) should've been able to maintain 3fps indefinitely since it generated smaller RAW files. It could not. Not even close.

I just benchmarked my SanDisk Extreme Pro card in a USB 2.0 SDHC card reader. Real life write speed was 33.0 MB/s. This card reader is very old, it was "new" back when SDHC was "new", one of the first SDHC-capable card readers on the market. That's a far, far cry from both the 25 MB/s you quote, or the 17.5 MB/s claimed by the K-5. Clearly the card is capable of a lot more speed, even without UHS-1. Therefore the bottleneck lies elsewhere.
Actually, if you check the long thread on dpreview, the K-7 can more or less maintain 5 fps indefinitely in JPEG (1 star, smallest file size). Also that thread has a fairly extensive discussion of why neither the K-5 nor the K-7 is constrained by image processing speed when writing out raw - it's more about the buffer layout and whether the raw image is compressed or not. It's of course up to you whether to believe any of this or not - just saying that not everyone agrees with your opinion.

As for your claim of 33 MB/s, I suspect you are confusing between instantaneous write speed (which is affected by caching) and sustained write rate. The USB 2 bus is capable of sustained rates of only 24-25 MB/s - regardless of how fast the card can or cannot do. Rob Galbraith's extensive benchmarks of SDHC readers show that there is no combination of card reader or card that exceeds this speed.

03-21-2011, 08:10 PM   #80
Veteran Member
Christine Tham's Avatar

Join Date: Nov 2008
Location: Sydney, Australia
Photos: Gallery
Posts: 2,269
Original Poster
QuoteOriginally posted by Hound Tooth Quote
I just took 36 RAW+ pictures (72 total files) at 1.5fps (that's how many shots it took to fill up the buffer). These were REAL pictures, no lens cap. I was using REAL exposure settings taking actual pictures of stuff around me as I held the shutter down. The SD card light was on the whole time. The camera wrote 944 MB to the SD card in 40 seconds. That's 23.6 MB/s.
That's interesting.

When I tried to repeat your test, I get different results (I was shooting in raw mode, not raw+).

First of all, my buffer never filled up - I was able to maintain 1.5 fps into 72 shots and the camera was showing no signs of slowing down.

The camera wrote out 906 MB in 56 seconds - effective write rate of 16 MB/s - not much different from the 7fps scenario.

Testing in raw+ mode vs raw is an apples vs oranges comparison. I would anticipate that the camera would have a a faster effective write rate for raw+.

PS - I'm not sure why you make a big deal of your pictures being REAL and shot under REAL conditions. All my tests are done like that (it's a specific scene - my living room - under controlled lighting conditions) - I consider testing with black pictures to be not representative of actual shooting conditions.
03-21-2011, 08:31 PM   #81
Banned




Join Date: Nov 2010
Location: Williston, VT
Posts: 268
QuoteOriginally posted by Christine Tham Quote
As for your claim of 33 MB/s, I suspect you are confusing between instantaneous write speed (which is affected by caching) and sustained write rate. The USB 2 bus is capable of sustained rates of only 24-25 MB/s - regardless of how fast the card can or cannot do. Rob Galbraith's extensive benchmarks of SDHC readers show that there is no combination of card reader or card that exceeds this speed.
It was a 1GB write using dd from the command line and timed that way. There can be no caching, the SD card wasn't mounted at the time. This is as accurate and unbiased a speed measurement as you can get. The data doesn't even exist until it gets written to the card. SanDisk has been bragging about 30MB/s for a long time, even before the UHS-1 speed class existed. This mythical 25MB/s barrier you refer to was broken a long time ago.

QuoteOriginally posted by Christine Tham Quote
Testing in raw+ mode vs raw is an apples vs oranges comparison. I would anticipate that the camera would have a a faster effective write rate for raw+.
That makes no sense at all. When shooting in RAW+, the camera processes the image ONCE and then saves it TWICE. The embedded preview in the RAW file and the JPG file are essentially the same picture, except one of them is compressed more heavily. Therefore, RAW+ increases the write load without increasing the image processing load. Based on that, RAW+ gives a more accurate representation of write speed.

QuoteOriginally posted by Christine Tham Quote
PS - I'm not sure why you make a big deal of your pictures being REAL and shot under REAL conditions. All my tests are done like that (it's a specific scene - my living room - under controlled lighting conditions) - I consider testing with black pictures to be not representative of actual shooting conditions.
Because a lot of the so-called tests in this (and other) threads use the lens-cap method for getting some mythical write-speed. All this does is generate the smallest possible RAW file, which minimizes the amount of data actually being written to the card. It does nothing to maximize actual write throughput.
03-21-2011, 11:08 PM   #82
Veteran Member
Christine Tham's Avatar

Join Date: Nov 2008
Location: Sydney, Australia
Photos: Gallery
Posts: 2,269
Original Poster
QuoteOriginally posted by Hound Tooth Quote
SanDisk has been bragging about 30MB/s for a long time, even before the UHS-1 speed class existed. This mythical 25MB/s barrier you refer to was broken a long time ago.
Not according to Rob Galbraith:
Rob Galbraith DPI: CF/SD Performance Database


QuoteOriginally posted by Hound Tooth Quote
That makes no sense at all. When shooting in RAW+, the camera processes the image ONCE and then saves it TWICE.
Actually, that potentially makes it up to 2 times faster.

In a typical camera, I think the real time OS has several threads running. When shooting multiple images, one thread copies the sensor readout to a raw buffer, another thread converts to JPEG, a third thread writes raw buffer to card.

The sustained write rate for raw depends on how fast this third thread can convert raw data into blocks to send to card.

When shooting raw+, potentially both the JPEG and the raw write thread can write to the card simultaneously, hence improving throughput (still subject to the max transfer rate of 25 MB/s though).

You of course don't have to believe the above. But it does explain why I get 16 MB/s writing raw in 1.5 fps and you get 23 in raw+.


Last edited by Christine Tham; 03-21-2011 at 11:16 PM.
03-21-2011, 11:25 PM   #83
Veteran Member




Join Date: Jun 2009
Location: Bridgetown West Australia
Photos: Gallery | Albums
Posts: 903
I think this thread re-defines measurebating to a whole new level!
03-22-2011, 04:16 AM   #84
Veteran Member
MRRiley's Avatar

Join Date: Feb 2007
Location: Sterling, VA, USA
Photos: Gallery | Albums
Posts: 6,275
Well I just ordered 3 of the 16MB cards (B&H $69). My feeling is, I want a card that is capable of taking everything my camera can dish out and I believe the Extreme Pro's will fit the bill. Especially after slogging thru this thread. LOL

Mike

Last edited by MRRiley; 03-22-2011 at 03:31 PM.
03-22-2011, 03:02 PM   #85
Banned




Join Date: Jan 2009
Photos: Gallery
Posts: 9,675
QuoteOriginally posted by Hound Tooth Quote
Because a lot of the so-called tests in this (and other) threads use the lens-cap method for getting some mythical write-speed. All this does is generate the smallest possible RAW file, which minimizes the amount of data actually being written to the card. It does nothing to maximize actual write throughput.
One difference in the original test is to fill the buffer, in taking 15 seconds of reallife pictures and time them and meassure them. Then take 60 seconds of pictures and again time them and messure them. The difference between the two would be the actual writespeed of the card with some degree of error.

Pictures to be taken: RAW at 1/250th sec and 7 fps at iso5000 so you create large files

QuoteOriginally posted by MRRiley Quote
Well I just ordered 3 of the 16MB cards B&H $69). My feeling is, I want a card that is capable of taking everything my camera can dish out and I believe the Extreme Pro's will fit the bill. Especially after slogging thru this thread. LOL

Mike
I do agree with you on this. The K-5 is not keeping up with this card, so this is the best choice for getting the most out off our K-5.


I started out with this test to find out wheater it was smart to upgrade from a classe 10 card or just to keep going on as I'm doing at the time.
03-22-2011, 03:56 PM   #86
Veteran Member
Christine Tham's Avatar

Join Date: Nov 2008
Location: Sydney, Australia
Photos: Gallery
Posts: 2,269
Original Poster
Speaking of card readers, does anyone know of a good UHS-I or SDXC card reader?

Preferably something that sits on a faster bus, like USB3 or eSATA?
03-22-2011, 11:09 PM   #87
Veteran Member
Chex's Avatar

Join Date: Feb 2011
Location: The 'Stoke, British Columbia
Photos: Gallery
Posts: 1,678
Is the difference in speed between a DSHC class 10 and UHS-1 or SDXC for your card reader.. does it really translate into enough saved time to warrant one? Even a 64GB card can be loaded onto your PC during an "good" bathroom break...
I do get trying to increase the controls for burst shooting.. that would be really sweet. But I think we're SOL unless there's a firmware update allowing it. Too bad you couldn't "overclock" the prime II processor and see if bumping up the bus speed would help speed up its transfer rates.
03-23-2011, 06:24 AM   #88
Veteran Member
bickrs's Avatar

Join Date: May 2009
Location: Sheffield, South Yorkshire
Posts: 327
I'll probably answer my own question here ...

I'm currently using a Transcend 8Gb Class 10 in my K-5 (1.03, image corrections off). I'm noticing that when review cycling through shots, whether to "chimp" or just look when not actively shooting, that it is fractionally not as quick as my K200D, but enough for me to notice. I'm reluctant to test my old San Disk Class 6 as it's still in use in my K200D.

I know the filesize is a lot bigger, hence it may take longer to read/dump from the buffer cache, so my question is, has anyone else noticed similar and does/will an Extreme Pro card help?

Cheers
David
03-26-2011, 08:48 AM   #89
Banned




Join Date: Jan 2009
Photos: Gallery
Posts: 9,675
QuoteOriginally posted by MRRiley Quote
Well I just ordered 3 of the 16MB cards (B&H $69). My feeling is, I want a card that is capable of taking everything my camera can dish out and I believe the Extreme Pro's will fit the bill. Especially after slogging thru this thread. LOL

Mike
Such a good point. Just ordered the 32GB version. So on monday or tuesday I will run my own test to convince myself.
03-26-2011, 05:25 PM   #90
Veteran Member




Join Date: Jun 2009
Location: Bridgetown West Australia
Photos: Gallery | Albums
Posts: 903
I have a Bugatti Veyron but it's just not fast enough, what can I get that will go that little bit faster?
Reply

Bookmarks
  • Submit Thread to Facebook Facebook
  • Submit Thread to Twitter Twitter
  • Submit Thread to Digg Digg
Tags - Make this thread easier to find by adding keywords to it!
camera, card, dslr, k-5, k-5 ii, k-5 iis, k5, pentax k-5, sandisk
Thread Tools Search this Thread
Search this Thread:

Advanced Search


Similar Threads
Thread Thread Starter Forum Replies Last Post
For Sale - Sold: 4 Sandisk Extreme III 4gb SDHC Memory Cards davef Sold Items 3 06-07-2010 01:02 PM
For Sale - Sold: Sandisk Extreme III 8GB SD cards sharonblue Sold Items 2 11-18-2009 12:45 PM
For Sale - Sold: 8GB SanDisk Extreme III SDHC Cards cajuncutter Sold Items 19 01-23-2009 04:38 AM
For Sale - Sold: Sandisk Extreme III 4gb SDHC cards -- NEW* -- free shipping geauxpez Sold Items 10 12-07-2008 01:11 PM
There's a reason why Sandisk Extreme III cards are so costly. Vulpix Pentax Camera and Field Accessories 20 05-21-2007 04:50 PM



All times are GMT -7. The time now is 11:03 PM. | See also: NikonForums.com, CanonForums.com part of our network of photo forums!
  • Red (Default)
  • Green
  • Gray
  • Dark
  • Dark Yellow
  • Dark Blue
  • Old Red
  • Old Green
  • Old Gray
  • Dial-Up Style
Hello! It's great to see you back on the forum! Have you considered joining the community?
register
Creating a FREE ACCOUNT takes under a minute, removes ads, and lets you post! [Dismiss]
Top