Okay, I think this is most likely a Windows (or java) limitation on the directory path length to those include files from the portable folder.
I moved the whole IDE install dir one level up and then it was able to find those files and compile correctly.
Too many sub folders!