Battery voltage dropping upon connection

Yes, it's quite possible. Coin cell batteries generally aren't used for significant currents, and likely have high internal resistance.

--
The QuadRAM shield: add 512 kilobytes of external RAM to your Arduino Mega/Mega2560