The controversial plans involve demolishing a historic hall and vicarage to make room for the new properties in Robertsbridge, east Sussex.