Basic maths: 10k? resistor, 5V voltage, 100µF cap=0.76 second LED fadeout

See the attached schematic.

You short the supply into the capacitor - add a small value resistor in series with the
switch if you want to avoid welding it shut and resetting the Arduino!