Thank you for the better diagram. It would be nice if we could find a proper instruction document for the logic converter. As it is all I can do is guess - so I may be wrong.
I thought I had a sensible guess, but when I re-considered it did not seem sensible.
Sorry, I don't know how the thing works or whether you are using it correctly.
Why not replace it with a pair of resistors wired as a voltage divider - like this
(5v Tx) ----- 3300ohm ----------- 5600ohm --------(GND)
|
(3.3v Rx)
...R