As I said, the datasheet specifically tells you what size resistor you need for a 20mA output for driving LEDs. The LEDs you're using (or claim you're using) are 20mA per channel. I really have no clue what you're trying to calculate when the answer is stated very clearly in the datasheet, in other words, YOU DO NOT NEED TO BE CALCULATING ANYTHING, READ THE DATASHEET.