Button switches bounce and so need some special treatment to count button presses without extra counts. My tutorial on the state change method shows how to reliably count button presses and how to wire switches to take advantage of the internal pullup resistors.
Use the switch case structure with the buttonPressCount to select the color to display.