Beep sound problem with MSGEQ7

when the end of the cable connected to the A0 input is floating, there is some random noise and when I touch the cable it changes prominently.

That is exactly what I would expect.

but when it comes to reading it through an Analog input,

What do you mean by that?
Can you post a schematic of what you have actually done. I can't marry up those photos with the schematic on that link.