Apparently I don't need to be concerned about someone blowing the amp by using a speaker with too low of an impedance:
Of course there is still the possibility of the amp blowing a small speaker, but I have to assume most small speakers you'll find can handle at least 5v at whatever their impedance is.