一、User: xx is not allowed to impersonate xxx'

解决办法:修改 core-site.xml 文件,加入下面的内容后重启 hadoop。

hadoop.proxyuser.xx.hosts*hadoop.proxyuser.xx.groups*

Tips:注意是 xx 不是 xxx

二、ACCEPTED: waiting for AM container to be allocated, launched and register with RM.

现象为:

  1. 查看 node 的健康状态:http://master:8088/cluster/cluster ,无活跃 node
  2. pyhive 执行 insert 命令卡住,一直处于 accept 状态。
  3. YarnApplicationState 为:ACCEPTED: waiting for AM container to be allocated, launched and register with RM.
  4. slave yarn 日志为:Retrying connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry policy is...

解决办法:

切记启动 hdfs 后,要配置启动 yarn。配置如下:

 yarn.resourcemanager.addressmaster:8032yarn.resourcemanager.scheduler.addressmaster:8030yarn.resourcemanager.resource-tracker.addressmaster:8031yarn.nodemanager.aux-servicesmapreduce_shuffle