Can I use a 3.7V battery for a 3.3V board?

He said Not a good idea.