Powering ATtiny85 with 4 AA batteries

You can put a 1N4004 diode in series with the batteries, it will drop to 6V to 5.3 and keep things safe.

A diode's forward voltage drop is a function of the current going through it. If that's what you have to do, put a electrolytic capacitor on the diode's cathode.