I figured they were separate issues so I made different threads. I guess I should have kept it in the same one.
Yes, I am using the example AccessControl.
... and I solved the problem! I think I made a weird wiring mistake at one point and accidentally filled up EEPROM with the records for just one card.
After clearing EEPROM it started working as intended.