Are you talking about one of this little 9V batteries? Their current capacity is pathetic, avoid them whenever possible.
Do you have a multimeter? Monitor the Vin and 5V node on the Arduino when using "DC Power." If your circuit is drawing too much current you'll see one or the other drop significantly.