Java zero-day security vulnerability

Hello,

Should be be worried?

yes, always, not only when there is a warning/alert...

I mean (I was approaching the subject gently), should we all stop using Arduino right now, on Windows systems or on all systems?

...should we all stop using Arduino right now...

That is certainly your choice but using or not using the Arduino IDE has nothing to do with the zero-day vulnerability.