Residents allege they were threatened by armed men, physically assaulted by builders demanding more money, and watched helplessly as strangers moved into their homes.