You do not have to exchange cards with the card you are given, if you do not want to. Instead, just pass the card you received on to the player to your left.
All players continue to circulate cards. It usually goes pretty quickly, and can be tough to keep track of! This is intentional, and makes the game more fun.