I've got appropriate buttons and caps for my serial LCD keypad panels:
The problem of long button shaft is that if you don't mount them, the long shafts are shaky and impossible to press. You will have to mount them.
An alternative is to use a membrane matrix keypad, which has adhesive to stick to a surface. You can use a serial LCD keypad backpack: