If you want to run the op amp from the 5V Arduino power supply, you want a "single-supply" op amp circuit, and you'll want a "rail-to-rail" op amp.
A typical general purpose op amp can drive its output to within a couple of volts of its negative supply and its positive supply. For 5V, that means that the output voltage will be between 2V and 3V; for 3.3V, it will hardly vary, if the op amp can work at all at that voltage. A "rail-to-rail" op amp can drive the output voltage to within a few tens of millivolts of either of the supply rails.
You'll also need a "virtual ground," sometimes called an "artificial ground." Typical simple op amp circuits are designed to amplify the difference between the input voltage and ground, and ground is normally between the positive and negative supply voltage. You don't have a ground in that range, so you need to generate a voltage reference that's between your two supplies - typically, that would be 2.5V for a 5V supply, and 1.67V for a 3.3V supply. A virtual ground can range from a simple and not-particularly-effective voltage divider, to an easy-to-use 2.5V reference IC, or lots of other kinds that are harder to implement.
Here's a link to Texas Instruments' collection of single-supply op amp circuits: http://www.ti.com/general/docs/lit/getliterature.tsp?baseLiteratureNumber=sloa058&fileType=pdf&track=no.
There are plenty of examples, and you don't have to be an electronics wizard to follow most of it. There's some discussion of virtual grounds, but it doesn't look to be overly clear or demonstrative. If you need more, just googlit.
Here's a link to adafruit's rail-to-rail op amp: http://adafruit.com/products/808.
You can find a bewildering array of rail-to-rail op amps at DigiKey by searching for "rail," and selecting Integrated Ciruits / "Linear - Amplifiers - Instrumentation, OP Amps, Buffer Amps."