After creating a portable folder within the IDE installation folder on C drive the IDE doesn't boot at all. You see the IDE pops open for a moment and then disappears.
You must have the Arduino IDE installed to the Program Files (x86) folder.
The correct place to create a working folder in Windows is NOT under the .exe directory, but in the AppData folder for the user.
I'm sorry to hear it didn't result in any improvement. Well at least the negative result tells us that accessing external folders is not the cause of the slowness. Unfortunately I'm out of ideas. The antivirus and the external folders are the only two potential causes of slowness I could think of. Hopefully someone else here will have another idea.