Yes, what ever you assigned the router, should be the gateway. So if the router has the IP address of 192.168.1.1, the gateway should be 192.168.1.1. The router is the DHCP.
"If you can't soar with the eagles, then don't fly with the flock!" - Oliver Sykes; Bring Me The Horizon