Which Arduino?
For a Nano you can use one power supply and feed it to the external hardware as well as the 5V pin of the Nano. You will still have the option to connect the USB to your PC.
For the Uno/Mega the same applies but it's not advisable to use both 5V on the 5V pin and USB at the same time.
No idea about other boards.