Computer stuck at Windows XP loading screen

Hello,

My computer gets stuck, not frozen at the XP loading screen. It happens every time when I turn it on. The little blue dots will continue to scroll but the computer will never boot up. The computer boots in safe mode easily however. Oddly enough one day, out of frustration, I hit the side of the computer and it hesitated for a moment and then actually booted up.

This primal method for starting my computer worked for a while but I knew it was not a permanent solution because I have been told hard drives are somewhat delicate. I bought a new hard drive and cloned the old one hoping the old hard drive was the issue. The computer had the same issue however with the new hard drive. I am out of ideas I was hoping someone would have some advice for me.

I also recently replaced the power supply and shortly afterward is when the issue began occurring.