This really looks like a PSU problem, so changing the power supply was a really good idea. Sadly, if the issue persists, I would advise you to check your motherboard. This is a serious port issue and may damage all connected devices. I would recommend you not to this risk and resolve the problem before using the PC again. You may need to seek assistance from a technician.
Hope this helps