I have seen people having this issue as far back as windows 8.1. I have made sure to try all suggested fixes from removing all the files from an older install of Arduino 1.5.6 but now I can't seem to figure out what to do. When I run the debug version of Arduino it tells me that it can't create the config file if I run it as a normal user. If I run as a admin user it works fine.
Maybe the problem is that you installed it while in administrative mode so you could try to reinstall as a normal user. If that doesn't work try setting the Arduino IDE to portable mode. To do this, create a folder named portable in the Arduino IDE installation folder.