Number of high-spending Chinese tourists visiting Japan halved last month after PM said an invasion of Taiwan could spark Japanese military involvement