Home networking issues

Hello,
I think it's an unusual situation but it's probably not. in my mother's house i have to set up 2 routers. where the main cable line (internet) comes in is in the basement. it's an old house and there's alot of concrete and steel down there. i have my work area down there but in a different room than where router 1 (linksys WRT54GS) is. i get great signal down there. when i come up stairs i don't get any. i ran cable upstairs to router 2 (Belkin Play). i have had router 1 for a while and just inherited router 2. I got the settings right for the belkin and it gets great signal i just cant get the settings right for the linksys. i can connect to the linksys but i can not get internet. i called tech support for linksys and my warranty is up. i don't have the money to pay to get it. Any and all help is greatly appreciated