good primes will always be better than good zooms at its respective focal length, until the aperture is stopped down 2-3 stops.
i enjoy primes because they do not compromise image quality, and are usually faster than zooms. however, this means, i carry around a number of primes and it gets heavy, even though they are small.
zooms make compromises in IQ and speed for convenience.
your prime beats your zoom at every aperture probably until around f/8 where it will even out (but maybe not. but 55-300mm is a good lens). your zoom beats your prime at every focal length except 135mm.
get rid of either and you will miss one lens' strength sooner or later. you will wish you had a faster lens for cloudy days, or you will miss the 300mm length when you see a bird that is just far enough away.
keep them both