Former health secretary said the prime minister dismissed evidence from British doctors, but doctors, Labour sources and campaigners question his sincerity