Arduino circuit/breadboard not working at higher voltage?

The 0.1uF would be great.

Are you in the US?
Browse www.dipmicro.com. $2.50 for shipping, great prices on stuff like this. Stock up a little qty 10 of things, prices drop down to 5-6 cents per part kid of range. They have some 'kits' of parts, collections of caps, resistors, LEDs I think too, you can be set for a bunch of projects.