Standalone arduino/capacitors

It wouldn't matter where the regulator and its electrolytics were, that 0.1uF cap is required always, right next to the chip. Decoupling capacitors should have low ESR and ESL, which in practice means ceramic, right next to the relevant pins. The exact value isn't too important,
BTW, so anything from 0.1uF to 1uF will work fine.