From prog cabaret and joyful jangle-pop to a pop star who will drag you to the club, here are the year’s finest LPs as decided by 30 Guardian music writers