Can I use a 3.7V battery for a 3.3V board?

Out of curiosity, I checked pin marked 5V, stm32f103 starts working from 2.6V