EEPROM on the ATMega328P

I always thought that was where you stick your compiled binary?

It isn't.

if not, what's it used for?

Storing other data that you want to persist when the power is lost/the Arduino resets.