Also I have no experience outside of the main arduino environment so looking inside a library is like trying to read a foreign language. anything involving HEX or binary is also very foreign to me.
I would encourage you to continue looking at libraries. Different libraries are written at different levels. Indeed, some will be more difficult to understand. Put those aside for now and spend time with the smaller and simpler ones. Write one of your own. Make it so simple it seems stupid. An LED library or something.
Learn the C and C++ languages.
Understanding hexadecimal and binary is fairly important to any computer-oriented discipline. Microcontrollers are, first and foremost, complete small computers. At the lowest level, computers only deal in binary. So if you understand binary, you begin to understand computers.
Get the datasheet for the microcontroller on the board(s) you use. For example, the ATmega328P
for an Arduino Uno. The datasheet is huge and overwhelming. Don't worry about the details right away, just look through it, get the lay of the land.
Play with connecting other devices to the Arduino. Simple things like shift registers, real time clocks or other things that interest you. Read their datasheets too. Try to understand how they communicate.
Take chances, get messy, break things, have fun! A little "magic smoke" is a good thing!