1. 程式人生 > >spark job一直顯示Application report

spark job一直顯示Application report

[2016-12-02T15:08:15.746+08:00] [DataProcessing] [INFO] [] [org.apache.spark.Logging$class] [tid:main] [userID:bdd] Application report for application_1480655448296_0002 (state: ACCEPTED)

增大記憶體,可以使用spark-shell測試

yarn.nodemanager.resource.memory-mb

yarn.scheduler.maximum-allocation-mb

CDH5.8.3似乎存在問題,spark-shell執行也是處於等待狀態,改用CDH5.9.0正常。不能使用CDH5.7.1,因為在JDK1.8下HUE連線配置會報錯。