The MAX7219 can uses three pins and can handle all 8 7-segment dsplays: http://www.adafruit.com/products/453
A pair of 8-bit shift registers can handle the 10 LEDs and can use the same three output pins.
You can get LCD's with I2C interfaces. They use only two pins (A4 and A5).