Is it ok to leave relay module permanently connected to mains power?

Overall answer- Ensure your mains side wiring is secured and safe from accidental touches and shorts.

A fuse/RCD is always a good idea..

If you need to ask, it’s probably not a good starting point.
In some countries, the mains voltage will ruin your day, in lthers it can kill you - dead.