You can but the AVR will also run scaled-down.
True. On the other hand, the timers would operate as programmed and that would probably be okay in a lot of applications. I don't envision the AVR doing much programmatically after setting everything up.