Input current on those things are tiny. So unless you have lots of capacitance on the line, or are driving them at super high speed, you are not going to run out of the fan out capabilities of the mcu.
I cannot follow your description - a graphic presentation, even hand drawn, would be helpful.