Attach picture directly here....
Your LED is missing a current limiting resistor
I can't tell form your drawing which pins of the buttons are connected. they go 2 by 2 usually - have you checked which ones are connected?
Best would be to either use the builtin PULLUP or if you want to use your own resitsor wire all on the same pin to be sure of what's going on
see for example this tutorial for buttons
You still need to handle bouncing
also where is your IR LED ? is 11 the default for whatever library you use? (some libraries use pin 3)