US Secretary of Defense, Leon Panetta called on Israel to "just get to the damn table" and renew stalled peace talks with the Palestinians in an address at the Brookings Institute in Washington on Friday.