Switching a relay on & off using a momentary push button

You also forgot to put digitalWrite(RelayPin, RelayState); anywhere. Since you never write to it, it stays LOW.