DrAzzy:
I browse eBay and when I see somewhat interesting things, I buy them to have in the future in case I ever want them. They're so cheap, I mean, why not? (and I generally buy at least 3 of anything, assuming it's cheap).
Exactly. You don't buy just one, and then fuss about when you want to work on another project, but not quit the first one.
DrAzzy:
If you want packs of common passives in a variety of values, or commonly used hobby ICs or transistors, you can get really cheap ones on ebay - search for the type of part and the word pack. On ebay, this gets you stuff targeted at hobbyists, for dirt cheap. Definitely recommend getting a resistor and capacitor pack, at minimum. sometimes they even include an organizer case.
The resistor pack is useful. And a LED pack. As JR mentions,
JohnRob:
You probably don't need a capacitor kit as the values you will likely use are limited. I would suggest you have on hand:
Ceramic (non polar):
0.01 µF 25 to 50V (usually 50V is a standard)
0.1 µF 25 to 50V (usually 50V is a standard)
Aluminum Electrolytic (Polarized)
10 µF
47 to 50µF
100 µF
And actually, a few 1 to 2.2 mF (1000, 2200 µF).
dougp:
For free parts with no shipping costs there's:
These are almost guaranteed to have some tactile switches, an I2C EEPROM and at least an IR sensor within.
Haven't seen any of those for a few years, thankfully. And the problem is, it's not shipping costs, it's disposal costs, unless you manage to de-construct it on-site. 
"Op-shops" can be good for power supplies and USB fittings. Even better, "Garage Sales" though there is an expenditure in time. This morning was unprofitable, it's getting thin on the ground around here.
thehardwareman:
I bought my first LED in the 1970's (does not remember the exact time - still have it!) from a show in Norway. The price was high and the LED did not produce much light. Today I can buy 100 LEDs from Ali Express for less than I paid for one in the 1970's and the light from the LEDs are much much higher 
Maybe more like 200 compared to the early '70s.
Although the 7-segment displays and address register indicators in my first SC/MP micro in 1978 weren't all that bad.
Hopefully the marketing hype with "high brightness" and "ultra-high brightness" is now dying out and we can accept that what is produced now is simply efficient and the original devices were essentially, developmental. There is probably not much more to be gained now in efficiency - though further gains in photovoltaics are apparently achievable, which will be very valuable.