As far as I can tell from the spec you have access to 5V at the following points:
USB port (x3)
40-Pin GPIOs (2, 4)
Pogo Interface
You have access to 3.3V at the GPIOs. This is a very limited supply and I would not recommend using it.
If I was doing this I would use one of the USB ports. Take an old USB cable and cut off the end that doesn’t fit the USB port. The red and black wires will be +5V and Gnd (but check! - some cables use other colors). Then connect them direct to the 5V LED, or via the recommended 43Ω resistor to the 4.4V LED from JayCar mentioned above, or via the appropriate resistor to any other bright white LED you choose.