LED Scoreboard w/ win-loss counter

I have rough blueprint/sketch of what I have pictured in my head and how it will look but being a new user on Arduino.cc I am unable to upload images yet.