Well, your startup params in the BIOS are wrong if you have to intervene with a keyboard press in order to boot. Change the CMOS battery first. Then go into BIOS and verify that your boot order is correct. Then after you verified that, make certain that USB ports are enabled.
How can you verify that the USB works when it hasn't booted yet?