I've just follow some of the instructions from people and found another way to fix it thoroughly.
First, we need to type Win+R or click on Run to type intl.cpl.
Then we choose Administrative and Change System Locale. Somebody say we need to change to our locale but I found it's not a must. We could choose whatever we like, for example my default one is English UK though I'm not living in UK, and I changed to English US and it's not where I live neither. Then restart as requested.
After logging in you go to Setting - Time and language setting, click on the language locale you've just chose and set it to default. After that click on the other ones and remove.