Button issue ATtiny84

Or maybe you have not used the right pin numbers

See this cheet sheet: