Never mind that issue. The Arduino wasn't 3v3, it was actually 5v but the usb-to-TTL was set to 3v3 volt. After changing that, it flashed just fine. But it won't respond to any AT-commands now 
Tried reflashing the firmware but did no good.
EDIT: Ops, missed the reset pin. It's now responding to AT-commands.