Can I use a 3.7V battery for a 3.3V board?

Apart from the problem of getting a safe voltage converter so that the battery can power the STM board, there's this other issue that we haven't even touched on yet: how to charge the battery?