How to handle a circuit switched by ground

So. you have a Regulator outputing 4.5v one one unit, but when u hook it to more that one it drops ?