it seems you want to send every sound sample you get with the rest of the data that won’t change as fast since their sample rate per second is much lower.
Assuming you can read them all at their best rate, Could you do with sending bulk data less frequently but a larger buffer ?
What’s consuming the bytes on the other side? How fast is it?