MapReduce任務執行到running job卡住
阿新 • • 發佈:2020-09-23
改變hadoop裡的yarn-site.xml檔案
舊版本
<configuration> <!-- Site specific YARN configuration properties --> <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> <property> <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name> <value>org.apache.hadoop.mapred.ShuffleHandler</value> </property> <property> <name>yarn.resourcemanager.resource-tracker.address</name> <value>192.168.2.140:8025</value> </property> <property> <name>yarn.resourcemanager.scheduler.address</name> <value>192.168.2.140:8030</value> </property> <property> <name>yarn.resourcemanager.address</name> <value>192.168.2.140:8040</value> </property> </configuration>
更改後
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>
參考資料:
https://stackoverflow.com/questions/24481439/cant-run-a-mapreduce-job-on-hadoop-2-4-0