You are reflecting many people's experiences here and this makes photographers quite lonely most of the time.
However, this is why shooting with fellow photographers sharing the same passion is so much more fun.
A few gatherings or outing with photographer friends are often fun where the whole group might stay in one spot for hours without moving onto the next. Regardless it is about macro, field trip to waterfalls or street shooting taking photos at random, it is almost pleasure to shoot with people who would appreciate your creativity or offer criticism of your work.
As Dan has mentioned to you, do what you believe that is important to do. This is a family outing. Your family would need to respect your hobby and appreciate that you are maturing yourself as a photographer instead of having you to nag on the rest of family members necessarily. Leaving you alone is working in their favour
I am sure they will understand that it is crucial to give you time and space while taking photos. If you started to concentrate on your loved ones with extra attention and attempt to double check on everything they did whenever you were interrupted taking photos, they would know that it is better to leave you alone ...