U.S. Vice President Mike Pence will visit Israel and Bahrain in early January, the White House said.