Prices have fallen more than 4 per cent in one Sydney suburb alone since May as the downturn saps buyer confidence at the upper end of the market first.