But if I where to desolder the LED, then the pin 7 of the TP4056 should act as ground when the light should be on. But should it also act as 5V+ when the light is off?
Yes BUT you need to keep the resistor in if you remove the LED. Do not connect pin 7 directly to 5V.