Arduino setup runs when relay activates

The initialization of the relay pin should be placed before setting its value:

pinMode(relayPin, OUTPUT);
digitalWrite(relayPin, HIGH);