Ah, could have been a Li- Ion, now that you mention it.
The original units that first came out didn't have the on off switch, but the cheap clones do, which allows you to keep the unit switched off (but still using solar energy to charge the battery) without the PIR triggering the LEDs.