AttachInterrupt after one second of holding button

That's a bit of a different thing then. An IR remote sends data codes, so holding the button for 1 second doesn't hold down the data line for 1 second, it just sends repeat codes at intervals.

What batteries are you using? What are you using to regulate voltage to the Pro Mini, or are you putting unregulated voltage on RAW?

I note that the device will only go to sleep if it gets the correct IR command. If you use any other IR remote in the vicinity of this device, it will wake up and check the code. If it's not the right code, it stays awake until it receives the correct one. I highly doubt that this is what you want.