Some will know this, but others may not.
I've just updated my two K-1 bodies from v1.40 to v1.55. As a consequence most AF fine adjustments were changed with this update ***. I've not seen a firmware update do this before. With two bodies and various lenses, this was a pain.
Anyway, it did give me a time to reflect on my AF testing. Some lenses have just become manual focus only, so no point in testing them. I have a couple of pairs SMC and HD versions. As the fine adjustment settings can only hold one adjustment setting for either the SMC or HD version, I had to choose what one was going to take priority and check the other to make sure it was not widely different - they weren't. So my testing combinations were reducing to more manageable numbers.
I then considered the testing setup. Why test in the usual way, when I don't use each lens the same way. ie my 77mm lenses are typically used for portrait at around 1 to 2m, whereas other lenses are mostly focussing at many metres. So I constructed the following. I also chose what part of a zoom range I preferred and weighted my testing accordingly.
I abandoned the try it three times at the same position method and moved the lens around on the tripod, focussing on the target at more representative distance. I took several shots at each AF setting at a wide aperture, with remote and mirror locked. It was quick and it felt much more like a real photo activity. The resulting files were revealing and more consistent than I've previously experienced calibrating with traditional setups. The firmware upgraded settings were different from my original settings and very close to my new ones, except *and this is key for me* for those lenses I predominately use for portraits and focus at 1 to 3 metres. These I had to adjust from the firmware reset figures by several 'units' (ie from +2 to -4). This set-up allowed my to move a much longer distance than previous calibration arrangements allowed and seeing my tests fall in line with the new firmware set figures was reassuring.
Time will tell whether this modified testing approach will be better. Spot testing with the 77 and 43, both of which I changed significantly negatively from the new firmware set numbers, seem to be working fine. Fingers crossed ...
*** The updated firmware adjusted from a range of 0 to +3. Some did not change, but some had jumped by 3 (all were increases). I wonder what would have happened if my camera/lens combinations had been nearer 10 ...?