Whatsapp account

Hello! I recently bought a new phone and gave the old one to my brother. On my old phone, I enter my brother's Whatsapp phone number. When I enter his phone number on WhatsApp, chats and groups of my account appear, although the phone number is different. I tried to uninstall the application and download again but nothing works. Please tell me what to do. Thank you.