Can I use a 3.7V battery for a 3.3V board?

Valid points; it's worth a try. Yes, my concern is the variety of clones that may use any kind of linear regulator including possibly an lt1117 or something similar, which could be problematic.