Former Justice Minister announces break from politics weeks after joining Tel Aviv mayor's new Israelis party.