Not the PCM8523 time clock it is the PCF8563 losing time? - SOLVED

That shows your project, not the part. I can understand your problem, they posted pictures but not a schematic. It is losing time because you have a 32kHz crystal, not a 32.768 kHz as the data sheet specifies. Change the crystal, it should work fine after that.