Darren Jones, the Chief Secretary to the Prime Minister, suggested the size of Whitehall departments should 'shrink' if some of their roles are moved away from London .