US president's reference to Japan's 1941 attack has shaken Japanese as PM Takaichi's silence gets mixed reaction.