Then you need to connect your LEDs like this:
NOTE: You will need to modify your code to set the output LOW in order to trun a LED ON.