Shoppers held back on Black Friday spending in November and budget uncertainty hit consumer confidence