I've never removed a memo holder, but I'd be surprised if you couldn't take them off. You may want to send a message to
MysteryOnion and ask him. If anybody knew it would be him.
I didn't see much point in them either until I started shooting more film. As a little kid with just one camera and one roll of film at a time they were pointless unless I was using it to hold a small Post-It note to write down aperture and shutter speed info. Now using multiple cameras and films at the same time it really helps me keep track which cameras are loaded with which film, e.g., B&W film in this camera, C41 color film in that camera, E6 color film in another camera, and custom film in the other camera. Now when I'm working on a project I know which camera to grab.