Focusing past infinity can actually be a benefit in some situations...
Manufacturing tolerances are such that a hard stop at infinity doesn't always mean perfect infinity focus. In the days of 35mm film, that wasn't such a big problem, but with high resolution digital sensors, it can be a very real limitation.
I have an absolutely wonderful Orion-15 28mm f/6 lens designed for Soviet rangefinder cameras. When I first tried it on my Sony A7II with the M39-to-E-mount adapter I normally use with rangefinder lenses, I could tell it wasn't quite getting to infinity. The significant depth of field meant that distant subjects were acceptable, but not pin-sharp. Since the hard stop isn't adjustable without modification (and I don't like to modify my lenses), I had a second adapter ground down very slightly, and I use it with that specific lens.
Lenses that focus past infinity might not offer quite the same convenience as those with a hard stop when infinity focus is required, but they work around manufacturing tolerances very nicely