When you shoot landscapes, how wide do you want/need to go? I'm a wide shooter, personally, and sometimes even find the Da 15 longer than I'd like for landscapes (though mostly it's great). I've owned the 12-24 and found it quite sharp (better than Da 15 in corners, too), and the FL range is awesome for 'scapes (IMO). YMMV. Downsides are size/weight and inferior flare resistance (by a lot) to the Da 15. Not sure how it compares to the 20-40 IQ-wise, but I think deciding between these two will largely be about your shooting style - IQ will be great on both.
Regarding digging into your pack for lens changes, I agree that would be a pain in the a**. If that is the only thing holding you back from primes, though, why not consider one of these:
Clik Elite chest pack? (they make various sizes) I have one, and have had clips sewn onto my hiking pack so I can attach the chest pack directly, then my camera (and usually 3 primes) are readily accessible. If you go the prime route, I'd suggest 15/31, but there are lots of combos that would work.
-Brandon