I am clueless about amplifiers,
That's tough because you are going to need to know about them to design something that is stable at these low voltage levels.
but I am capable of following directions or using formulas to find the right part values.
It's not as simple as that, this is a sort of 'one level up' project from the simple following instructions. A lot depends on layout and construction quality, it's not something you can lash up on a bread board.
Have a look and see if any pre built amplifier boards will do what you want.