My PC won't start if I plug monitor to Mobo

Hello,

I am facing a strange issue bellow

If I connect my monitor to mobo, the PC won't start. When I press the power button, cpu fan keep spinning,
HDD does not appear to be running(the led signal just lighted on for some second and off forever), no sound, no bipp ... . Nothing in my monitor screen

But If I remove the monitor (unplug the monitor cable) from mobo first and press power button, then the PC will work. I can connect monitor back to mobo after that and everything just works fine

I mean my monitor still work, but I need to remove it from mobo before pressing power button
I don't have extra graphic card, just use default port of mobo
My mobo is Foxconn H61MXL-K

Is there anyone faced this issue before? What can I do to solve it?

Thank you so much for your help