Lured by a beautiful waterfront, subversive music venues and quirky independent shops, Claire Boobbyer discovered a Suffolk town waiting to be rediscovered