The five cards are not kept by each player. The cards (example: 5 cards for 4 players = 20 cards) are arranged in the boxes (face up) around the eye on the game board. Any additional cards are left off to the side and are used to fill in the empty space as a card is selected on a player's turn. The player selects a card, hands it to another player without looking at the back and names who/what on the front of the card. If successfully named, the player can then choose the type of trivia question (true/false, multiple choice or open ended) to be asked from the back of the card. We really enjoy this game. Good for ages 12 and up knowing that some subjects like wildlife are usually more familiar to 12 year olds than historical politicians.
Use those to make the card color combinations that give you extra points at the end of the game. You just keep them in front of you while you are playing the rest of the game. They only count at the end.