Question about taxes?

Does anyone know if you are able to choose on each pay check to be exempt from federal tax with holding. In the end...will you have to end up paying back what you owe or will you be penalized in your taxes for choosing this? Even though your not really exempt from the federal tax with holding.