@flokatier, your topic has been moved to a more suitable location on the forum. Installation and Troubleshooting is not for problems with (nor for advise on) your project 
See About the Installation & Troubleshooting category.
I have no experience with ATtiny85 but it might help others to help you if you post a link to the board. It sounds like your voltage regulator on the board can't supply enough current. If the voltage regulatore is a standard 1117 or 7805, don't forget that the access voltage multiplied by the required current is converted to heat and there is (nearly guaranteed) no real heatsink on your board.