For 50 or so switches I am just going to concentrate on the shift registers and the debounce code that I have working, it seems simpler (at least to me). The 74HC165's are easy to read and I can daisy chain enough (with the 74HC125 buffer IC) to run off the SPI bus of the Teensy.