Just a little follow-up. I was able to get output with KnockBang. I have attached the led to attiny's pin 3 and the button to pin 0. This does not interfere with the programming via Arduino Uno.
And writing and reading from EEPROM works too I needed to convert values with int() and byte().