'Why would we accept a proposition that would see a decline... because of the Brexit decision?'