It's up to you. Two channels stereo are independent, but very close in most audio program. They differ in phase, that isn't important for your project.
So you can take just one left channel, or connect two in parallel. Have you considered to build two channel display?
Btw, you need a DC offset for analog input,.