A former prizewinner heading this year’s jury said many of the 153 novels submitted were not worth discussing as judges whittled down the list to six contenders