Originally Posted by navcom 
Even though the EXIF data is not huge, for this option, every little bit of space helps
This is pretty much a holdover from the days of slow dialup Internet connections, when the small amount of extra space meant several seconds of waiting per picture. It's pretty silly today.