Most electret microphones are not "5V" and can safely be powered from 9V. Post a link to the data sheet for yours.
up why shouldn't I use a 10.1 uF across each battery instead
The two types of capacitors have very different frequency-dependent properties. 10 uF is used to reduce low frequency noise, while 100 nF is used to reduce much higher frequency noise.