I've never tried it, but it would seem to me that mounting the lens/adapter pairing to the body would be more awkward than just mounting the adapter by itself. I guess as long as the thing gets securely mounted it really doesn't matter. I just got the mistaken impression that you were doing this even when swapping lenses.
Click on the image to view it in a larger size
S-M-C Takumar 105/2.8