The celebrities who call this riverside idyll home include Sir David Attenborough and Tom Holland - but mingling with famous names comes at a price, writes Sarah Tucker.