LM317 not working as expected

Longarms:
Adding a 1k resistor to the output didn't change anything, but thanks for the tip, I'll keep that in mind.

You did hook the other end of the resistor to ground, right? It's to put a minimal load on the regulator's output.