North Korea has demolished the liaison office on the border with its neighbor to the south, Seoul media reports.