USB of ATMega32u4 not recognized, error 43, custom pcb

Hello,

I hope that I post this at the right subforum, otherwise please let me know.

Attached you will find a pdf of a schematic I made. The problem I am having is that the device is not seen as a Arduino Leonardo after uploading the Caterina bootloader over ISP and connecting it with the usb connector.

A few notes:

  • There is also a resistor of 10k ohm between Vcc and PE2(HWB), I forgot to include this in the picture.
  • There are connections in the schematic that I left out of the picture. I did this because they are NOT connected on the physical PCB as well.
  • When the usb connector is plugged in to a computer, it looks like the ATMega32u4 resets itself four times in a row before windows shows up the error message in which it says the usb device is not recognized.
  • If I connect the device to a power-only usb cable, it does not seem to reset itself.
  • In device manager it says the error code is 43. The usb device descriptor could not be retrieved.

Things I already have tried:

  • I put two resistors of 22 ohm in series with the D+ and D- of the usb data wires
  • I checked if there were any shorts, but I could not find any.
  • I tried different fuse bits.

My questions:

  • Which fuse bits should I use for this setup with an external 16MHz crystal?
  • Any idea what I could have done wrong that causes the USB connection to fail?

I look forward to your replies and hope someone is willing to help me! (Thanks in advance)

632293cee0[1].png