Power Supply voltage dropping - faulty supply ?

and that their effect on the system voltage should be almost instant after power is applied ?

Not too sure what that means.

that I have a faulty power unit

Yes that would be my guess as well. Just remove all the load to check but it sounds lie a faulty supply.
Of all the parts in a system the power supply is nearly always the most unreliable.