With a starter kit you can explore different uses of Arduino for a good while without having to round up all the bits yourself but it's going to cost more.
If the kit doesn't have a multimeter and you don't have one, get one! It's your hardware watch-window. You can avoid a lot of mistakes by using the meter.
When you're done with the kit, Harbor Freight sells things like these for $4 each, great for resistors, caps, leds.
They used to sell a magnifier visor with set of 4 lenses but now only have the lesser one but check it out.
Maybe a pair of reading glasses or two will come in handy for close work.
They also sell the Helping Hands, I see a new (to me) one, the Jumbo.
See about getting different size plastic bins for bigger stuff as you find them on sale.
Shop around for assortment packs of components and IC chips -- they are the best way to flesh out your components.
Shop around for modules. Modules are cheaper than shields.
Check out DuPont cables instead of buying loose jumper wires. They come with male or female ends, when you want to jumper a header pin you want a female end. You peel as many wires as you need off the original 40 wires and have your own cables instead of a total rat nest.
There's another kind of jumper I don't know the name of but they lay flat on the breadboard, can be a pain to insert (need needle nose pliers) and remove but they make far more solid breadboard connections than floppy jumpers.
Brush up on your physics. There's a site called Hyperphysics that I have found very helpful.
Great that you can do the software and are accomplished with state machines (errr, finite that is).
If you go through Nick Gammon's tutorials you can pick up on electronics and Arduino specifics in a subject you already know the rest of. The 3 addresses in my sig space at the bottom of this post make a good start but for you that whole section of his site should provide loads of interest on a number of topics.
Also, go through the whole Arduino main site and build a folder of bookmarks to every part that looks interesting for now or later. There is a rather hefty manual's worth of material on-site with much in The Playground (not all perfect but what is?).
Books... even Sam's has Arduino manuals.