Were you using the Rokinon 8,mm f/3.4 fisheye lens? I've had TERRIBLE luck using my fisheye with video on My K-3. Check out the intro six seconds to this video:
Set it to HD in the settings and you'll see it's REALLY soft for an HD video. That level of quality, or lack thereof, continues for each shot using the Takumar 17mm f/4. However, here's another video with the same lens:
The second is significantly sharper and it's the same lens. So here's my theory on Pentax DSLRs and fisheyes and video: I think that the lenses capture all the extraneous overhead light (you can see in your video how blown out the sky is) and that light just bounces around in the lens like a pinball in a rubber band factory. I think that the cameras are recording excess light and contrast loss as artifact noise and softness. In both cases DSLR was in shade. In the first, the sun was overhead and in front(ish) of the lens. In the latter, it was setting and off to the side or slightly behind the lens.
Nothing in your settings appears bad and your bitrate is really high, so there's no reason from a video quality perspective for there to be any issue. I think it's just a limitation of Pentax DSLRs with fisheye lenses in the sun when shooting video.