Getting into electronics and need help starting a parts collection.

Silman:
What other parts do i want to have on hand and where do should i buy them?

That TOTALLY depends on what you do with your Arduino.

Do you use it to light up LEDs? Drive motors? Build robots? Log analog values to SD cards...?