Linear pot is not quite linear

I'd guess you have an audio taper pot. Our ears are not linear and volume controls are designed so the signal is much lower than 50% at the mid-position.