Think about what your sketch does: It waits 1 second using the delay() function. THEN it begins calculating the seconds, minutes, hours etc. numbers. This also takes some time. Only when all calculations are done and sent to the LCD then the next delay() is called. This will not keep the correct time even if the processor speed is correct.
Search the forum for "timing without delay" will give you tons of tutorials of how this can be done right