EEPROM better than SD card for audio ?

Have you seen the APR9600 IC? Sounds like it is a full solution for your requirements in just one IC.