Is 51 degrees (C) (124 F) too hot for the voltage regulator?

I'm not aware of any commonly used regulators that have issues with 51c.
If you want it cooler you can glue a heatsink onto it, but IMO it's just fine.

If you touch it and it burns you instantly (or very quickly), that's too hot.