Where did all my memory go?

The Arduino IDE is just a bit too "black box"-ish for me to figure out how to do this.

Use Atmel Studio instead. It is a free professional IDE.