If it shows that you're logged in on your device, but even if the city doesn't match, that shouldn't be problematic. The location indicated isn't always accurate. Just check your phone to make sure that it isn't hacked or doesn't contain a malicious application.
For better security, I recommend you to enable the 2-factor authentication for your Instagram account. Update your contact info if necessary before enabling it.