Yes, capacitors are required, but their absence doesn't explain to me why the output isn't pretty close to 5V. Technically speaking, a transformer doesn't supply positive and negative, but AC. What exactly is the "transformer" being used here? DC needs to be supplied to the circuit as illustrated.