"I make absolutely no apologies for making sure that we get back a young man to his parents and that the American people understand that this is somebody's child," Obama said.
"This is not some abstraction, this is not some political football," he told a news conference. "As Commander in Chief of the Armed Forces, I am responsible for those kids."
Bergdahl was captured in Afghanistan in 2009. Some soldiers have said he walked away from his unit, and have alleged at least six soldiers died trying to find him.
He was freed last week in a controversial prisoner-swap deal that saw five Taliban militants released from the U.S. prison at Guantanamo Bay, Cuba, and flown to Qatar.
Republican members of the U.S. Congress have said President Barack Obama set a dangerous precedent with the swap for Bergdahl and might have broken the law.
Obama called the uproar "par for the course" and said he is "never surprised by controversies that are whipped up in Washington"