5 V power on board turns off

Jaspreet:
i noticed that whenever i connect anything between the 5V supply, the board turns off(lights go out).

Between the 5V supply and what? Take a clear photo of your setup. Show how the wires are connected to the mouse, and how they are connected to the Arduino.