Can I use a 3.7V battery for a 3.3V board?

Yes, and all those dev boards are supported by the official STM Arduino core.