Let's say we have a digital potentiometer rated at 1kOhm and 256 steps.
Does that mean that the potentiometer can output resistances in steps of 1k/256 = ~4 ohms? (e.g. 0, 4, 8, 12, 16ohms,...)
Excuse my ignorance for I have much to learn 
You've got it. That's exactly right.
Awesome, thanks 
You, pretty much, got it! That's, almost, exactly right.......
Just like real pots, Digital pots have end resistances on the A/B terminals and on the Wiper terminals.
That means that you approximate the step resistance by subtracting the A/B end resistance, divide by the steps, and when you calculate the resulting voltabe between A-Wiper, or B-Wiper, at x number of steps, you then have to add back in the wiper resistance.
Be a real good idea to refer to the datasheet for the type of digital pot that you plan to use.
Sparkfun sells MicroChip 413x's, I believe.
I was playing with DS18030-100 some time ago, it was supposed to be 0-100K but when I measured it, it was 0-80K; so mind that