Notice the 0x at the beginning of the numbers. That means they are interpreted as hexadecimal.
Do this to make it easy on yourself:
#define RN4020_EXTENDED 0X80
#define RN4020_AUTENTICATED 0X40
#define RN4020_INDICATE 0X20
#define RN4020_NOTIFY 0X10
#define RN4020_WRITE 0X08
#define RN4020_WRITE_WITHOUT 0X04
#define RN4020_READ 0X02
#define RN4020_BROADCAST 0X01
Then to make a composite value, you just add the macro symbols: RN4020_NOTIFY + RN4020_WRITE_WITHOUT