Nah, the EEPROM is not fast enough, its only 400khz, while we would need something faster.
Now I wonder about another thing, creating a sine/saw/pulse based oscillator controlled via midi. I wonder if I would be able to get 6 voices, or if I would need to build a wavetable and read like drum sounds instead.
Not sure when I will have some extra free time to work on this, but I'm sure curious to see what could be done with this idea. 
Wk