How to remove Arduino IDE comletely! from my PC

You may want to look at installing the portable version of IDE 1.8.19

That way you assure that everything is kept in one directory tree. I have 27 different portable installations of the V1 IDE on my PC even dating back to version 1.0.5-r2. They all run totally independent from each other.
All with their own tweaks and tunes, usually targeted to a specific MCU.