As with many things in life, the issue was the loose screw behind the camera. When I thought I had this lens focused at infinity in the daytime, I didn't. Tried the 3.5m and infinity thing out on my deck after work today, and now I've got it so it goes just a bit past infinity focus sitting on my deck at 12°C. The distance scale is nowhere near accurate, but it at least goes to infinity and beyond. I scouted out another spot for hopefully a decent milky way picture on my dirtbike today, and might try again tomorrow morning before work. Thanks for the help guys.
Previous travel stop.
Focused at infinity now.
I might try to get the focus scale lined up better with the markings if it bugs me, but that can wait for when I have more time. I don't generally do hyperfocal focusing, but I can see it being useful having an accurate distance scale with this wide of a lens.
Kristian