Found myself an LCD display (A-503GA) from an old PC chasis, only it's common anode:
An LCD does not have a common anode or common anything else for that matter.
How would the hardware part go? Just invert the current direction and LEDs, so that the current flows into the IC output pins?
No just wire it between +5V and the shift register pin to sink current through it.