Did you have an installation Cd when you bought the router you must re-configure your router to be able to access internet , Once you have made the setup on 1 pc the router will share the internet connection with the other one
Try this command to check whether all your post is connected to the router
Go to start Run
A dos interface will appear
Then type Ping. your router id
Ping. 168.0. ect..
Check whether the connection is here