Ok I've finished fiddling with it. Here is the design so far:
I ditched the ICSP connector to save space.
Since I'm breaking out SPI anyway, it'll be simple to make a adaptor.
The labels need to be moved around a bit as well.
It should be breadboard compatible and you'd be able to use a DIP-16 socket if you wanted.
You can also solder it directly to a LCD or even put a socket on it so its removable.
Any feedback?
Also what kind of transistor should I use?
It controls the backlight so it needs to handle about 200mA.