HC-05 advice needed

Stop me if you have heard this one…

So I have a RetroPi and I would like to make the joystick controller (which is in a cigar box) wireless, with the pi behind the tv. I was going to pair two HC-05 bluetooth chips if possible. I understand the concept of pairing them and all but was wondering if I could just plug them into the usb via a usb to serial board because it seems the simplest. However, if there is an easier way, or if my idea is not going to work, please let me know.

Thank you in advance for your guidance