and that their effect on the system voltage should be almost instant after power is applied ?
Not too sure what that means.
that I have a faulty power unit
Yes that would be my guess as well. Just remove all the load to check but it sounds lie a faulty supply.
Of all the parts in a system the power supply is nearly always the most unreliable.