It comes down to cultural flexibility vs. cultural rigidity, doesn't it? Both China and Japan fear the challenges to their culture that a large influx of immigrants would represent. For that matter, any authoritarian regime, which regimes are by definition rigid, must fear significant immigration.