Your lens will have 'sweet spots' of aperture/focal length combinations that give you the best sharpness the lens is capable of. But sharpness isn't always the main goal. Sometimes you need the reach of 320mm. Sometimes you need very shallow or very deep DOF. As
BigMackCam said, you can always do some judicious sharpening in PP.
The president's heads at Mt. Rushmore are huge, requiring lots of DOF. Fortunately, the more you focus out toward infinity, the more DOF you get. I assume that where you'll be standing will be hundreds of feet away from the heads. Just for the heck of it, I used the DOF calculator mentioned above and plugged in values of 320mm focal length, f8 aperture, and 500 feet focus distance. These resulted in a total DOF with acceptable sharpness of 267 feet! YMMV.