I am interested whether this works easier with simply connecting IOREF to 3V3.
No.
As far as I know, supplying voltage to the IOREF pin changes the input/output reference which is normally 5V.
No that is not how it works. It is simply an output that lets shields know what voltage it is running from.
do I understand it in the right way?
No.