what if I remove ATmega328 from Arduino UNO R3?

Yes.
Buy some extra controllers for projects like this.