Yep. Pockets. I keep rigid lens hoods on just about every lens, and usually don't cap them except for storage: a rigid hood pointed down in the bag is usually just as good. With exceptions for more vulnerable lenses, they come off and tend to stay off, sometimes until I get home.
Cap-keepers are awfully-annoying, which seems to be the OP's complaint. I do have a few caps with strings or keepers they came with that I didn't bother to remove, which are never attached to anything, ...just to make them easier to remove, or to realize the lens is capped without looking, and such.
One trick I do use is for rangefinders: anything you might actually shoot with without noticing the cap is on. A dangly string on the cap with a little bead on it will kind of bang around and make itself known,and help prevent any embarrassing shooting-with-cap-on situations.