1. 程式人生 > >【原創】大叔經驗分享(46)用戶提交任務到yarn報錯

【原創】大叔經驗分享(46)用戶提交任務到yarn報錯

nim use ima tps 原創 ask 圖片 bmi cfg

用戶提交任務到yarn時有可能遇到下面的錯誤:

Requested user anything is not whitelisted and has id 980,which is below the minimum allowed 1000

這是因為yarn中配置min.user.id=1000,yarn認為id小於1000的是超級用戶,yarn禁止超級用戶提交任務;

Each account must have a user ID that is greater than or equal to 1000. In the /etc/hadoop/conf/taskcontroller.cfg file, the default setting for the banned.users property is mapred, hdfs, and bin to prevent jobs from being submitted via those user accounts. The default setting for the min.user.id property is 1000 to prevent jobs from being submitted with a user ID less than 1000, which are conventionally Unix super users.

改為更小即可

技術分享圖片

然後重啟yarn

參考:https://community.hortonworks.com/questions/23914/requested-user-hive-is-not-whitelisted-and-has-id.html

【原創】大叔經驗分享(46)用戶提交任務到yarn報錯