Don't pull excessively, or you'll rip out a solder pad. If the potentiometer feels stuck, follow the previous three steps to try to remove the solder residue holding the potentiometer in place.

You can also try heating each joint as you wiggle the potentiometer out of the board. This is best accomplished with extra helping hands from a friend.