Liudr is right. You could conceivably do what you said, but you need 2 rows and 2 columns, so that is 4 inputs. You may as well just hook up 4 buttons.
But yes, you could connect up the first two columns and the first two rows and save 3 pins compared to what you are doing now.