What other parts do i want to have on hand and where do should i buy them?
That TOTALLY depends on what you do with your Arduino.
Do you use it to light up LEDs? Drive motors? Build robots? Log analog values to SD cards...?
What are the necessary parts to buy in order to drive motors and build robots?