Which board are you using?
Do you have anything additional connected to the board?
What type and size of battery have you connected to the board?
Are any parts on the board getting hot, in particukar the regulator, when the battery is connected?
Is the battery voltage still ~12V when it is connected to the board?