ATtiny..... Is it really that simple?

Peter_I:
10k as pullup to make sure it is not accidentally sent low by some naughty stray electrons and resets?

Yes.

The capacitor? To reduce noise?

Yes.