The Ground pin of the Arduino is connected to the negative terminal of the battery so you should be able to run positive side of the ~3V battery to an Arduino analog input without problem.
The Ground pin of the Arduino is connected to the negative terminal of the battery so you should be able to run positive side of the ~3V battery to an Arduino analog input without problem.