The MUX is also kind of a buffer, so there may be conflicts. Please show a schematic picture of arrangement (data flow)
from master through buffers, cable and mux to the slaves.
Wire.endTransfer() covers the entire transmission from master to slave. Only here transmission problems can occur.