Yeah unfortunately I am also running into the Orange LED of Doom with my Portenta. I loaded an Edge Impulse model onto it (in Arduino library form) and it was working. At some point it started showing a solid orange LED and now it won't respond to anything 
Had high hopes for the Portenta... hoping to get some support from Arduino on this issue because the board has great potential!