Uh oh...

Yes it would be as a function of writing a HIGH to the pin while it was still in INPUT pinMode (while thinking it was in OUTPUT). I guess I need to understand how those internal pullups work in order to answer my own question.