The views of the former Tory vaccines minister clash with those of high-profile members and the party faithful