An ICSP header on the board edge is an excellent idea! I've done something similar by soldering a DB9 connector onto a board edge. The spacing between pins 1-5 and 6-9 feels like around 50 mil so once pushed onto the board edge and soldered into place was very rugged.