Rishi Sunak has said that he understood why Brexit voters were “frustrated and angry” by the more than doubling of net migration since the EU referendum.