3 color LED via Arduino - how?

Since the Arduino can't 'toggle' the ground pins at all (at least that I understand?)

Yes it can, it can switch a pin between 5V ans ground.

You need to keep the current below 30mA otherwise you need a transistor to get more current.