Switching the TX and RX pins did not work. And thank you aarg as using the uno as isp programmer worked in loading a blink sketch to homemade board did work! And that will work for now!
I would still like to get the adapter working since that would be easier in the future.