Thanks for your reply, desordenado. That ALSA configuration certainly helps, but there are still a lot of artifacts being added even when no audio is playing.
madplay does add it's own high pitch whine compared to aplay playing a predecoded wav, do you think mp3123 would do a better job of decoding?