U.FL Connector Very Flimsy

The U.FL connector on my GPS Breakout Board (from Adafruit) is very flimsy and comes disconnected easily. Can I solder the connector and the wire together (while they're connected to preserve the data connection)?

Thanks!

If you are careful: Yes.