74LS164P shift register, in sinking configuration?

How would the hardware part go? Just invert the current direction and LEDs, so that the current flows into the IC output pins?

No just wire it between +5V and the shift register pin to sink current through it.

So when the pin is low it's always shorted to ground?

74HC164 sinking current.jpg