There is growing talk of a proposal to trade five terrorists held captive at the Guantanamo Bay prison for the release of Sgt. Bowe Bergdahl, the only American soldier held by the Taliban.

Bergdahl's father revealed the secret talks this week after becoming frustrated by delays.

Secretary of Defense Leon Panetta responded to the reports at a joint news conference with U.S. Joint Chiefs Chairman General Martin Dempsey.

"On the issue related to Guantanamo transfers, my position hasn't changed," Panetta said. "I would only take those steps in accordance with the law, and the requirements of the law and at this stage, frankly, there are no decisions that have been made with regards to that."

The proposed prisoner transfers would be the first of its kind between America and the Taliban.