Can I use a 3.7V battery for a 3.3V board?

Almost. The STM is specified 2.0-3.6V, absolute maximum 4.0V