If you operate on a battery the arduino boards (with leds and other stuff) will draw more power than a design without the bells and jingles.
There are ways nevertheless to get rid of some of those "power hungry" components and build a low power design from boards such as Arduino Pro Mini. Arduino no longer manufactures those but there are lots of clones available and it’s the same 328P underneath