Well, I suppose it could be modified to work without the shield. But, what's the Point? The spectrum is used to sense Audio. The sketch responds accordingly. If you attached potentiometers to the analog Pins instead of the spectrum, you could turn the pots and the sketch would respond accordingly.
If you want to remove the spectrum shield, what are you planning on doing with the sketch? How should the Project function? What is your desired effect?