Most laptops have tabs that keep the memory locked in place. Once the tabs are released the memory card is rotated upwards before it can be removed.
If this is a used laptop perhaps someone broke the tabs and then glued the memory in place so they could sell it to you.
Using excessive force is not a good option. But, you only know what is excessive after you have broken the laptop.