Pin 4(+) and 6(-) connect straight to the USB power connector according to the schematic. I’ve powered these boards like that before. I’d check that the supply doesn’t dip below 5V. I’ve had short spikes at startup on similar boards that I could only pick up with an oscilloscope. Sometimes just putting a large cap at the board helps especially if you have long supply leads.
