OK, so I have read quite a few other threads that discuss this and it appears that powering an Arduino with a super capacitor is not a great idea. It also looks like you can't just put in the capacitor, you need to add circuity to regulate the power coming out (maybe going in as well.) Anyway not a big deal for my project so unless I'm missing something I guess I'll abandon the idea.