How fast can relays get?

What's the application? If you need pulses of 50kV at a few mA, it's easier to generate pulses at a lower voltage and step them up using a transformer. If you need to interrupt an otherwise continuous 50kV supply, you could derive the supply from an inverter and switch the inverter off to interrupt the supply, if you don't mind the supply taking a few milliseconds to turn on and off.