Start with something that reads your sensors and can tell you the score using the serial port. Don't use Strings at all. Only when that is working reliably should you move on to the display.
You might find it useful to write the code that does the display as a separate sketch initially and just have it run through all possible scores as an early test.