Exclusive: Union body finds workers describing themselves as ‘gambling’ because wages felt like the outcome of chance rather than work