Question about 12V LED power supply

Hello! I made a wall lamp using couple of 12V leds and power supply which converts 220 Volts to 12 V. I made the on/off switch to 12V side of the power supply, so the 220 V is always running inside the power supply. Is this safe or should i make the lamp swich to 220 V side, so when i turn off the light, the power supply also is turned off?