Arduino Giga RTC doesn't remember the time

Try and use 3.3V from say another Arduino board and run the RTC sketch at https://docs.arduino.cc/tutorials/giga-r1-wifi/cheat-sheet/. Make the necessary change as shown in the screenshot (screenshot from my test) below to reflect the current time and date.