The SPI bus is, by definition, a bus. You need to understand what a bus is - and its ability to carry several passengers. If your display is an SPI display it can join the bus, along with the other SPI passengers. If you are using the SPI pins for non-SPI operations, It might be time to reconsider this.