if I want more segments, then I'd be close to pushing the 200mA total.
Only if the all the segments were on at the same time. You can multiplex them, (rapidly turn them on an off) not only to save pins but also to save current. However, multiplexing will make them dimmer and you can have exactly the same effect by dropping the current through the segment. Have you tried seeing how bright they are at 10mA? It won't seem half as bright because the eye has a log response.