How to power the board directly

Not so fast - what do you mean by "SPI connection" on the analog pins?
SPI has a specific meaning, and the '328P has specific pins to drive signals:
D13 SCK
D12 MISO
D11 MOSI
D10 tyically used as Chip Select/Slave Select. Other pins can be used; D10 must be set as an output to enable Master SPI operation.

A4/A5 are I2C pins (I think A4 is SDA and A5 is SCK, I might have those swapped).