1. 程式人生 > 實用技巧 >MapReduce任務執行到running job卡住

MapReduce任務執行到running job卡住

改變hadoop裡的yarn-site.xml檔案

舊版本

<configuration>
<!-- Site specific YARN configuration properties -->
<property>
  <name>yarn.nodemanager.aux-services</name>
  <value>mapreduce_shuffle</value>
</property>
<property>
  <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class
</name> <value>org.apache.hadoop.mapred.ShuffleHandler</value> </property> <property> <name>yarn.resourcemanager.resource-tracker.address</name> <value>192.168.2.140:8025</value> </property> <property> <name>yarn.resourcemanager.scheduler.address</name> <value>192.168.2.140:8030</value> </property> <property> <name>yarn.resourcemanager.address</name> <value>192.168.2.140:8040</value> </property> </configuration>

更改後

<configuration>
 <property>
  <name>yarn.nodemanager.aux-services</name>
  <value>mapreduce_shuffle</value>
 </property>
 <property>
  <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
  <value>org.apache.hadoop.mapred.ShuffleHandler</value>
 </property>
</configuration>

參考資料:

https://stackoverflow.com/questions/24481439/cant-run-a-mapreduce-job-on-hadoop-2-4-0