No, you shouldn't.
Do you know if it has a sufficiently low drop to still work if the battery supplies only 3.8V or so?