1. 程式人生 > >17-hadoop-yarn安裝

17-hadoop-yarn安裝

img source clas shu framework apr 好的 vim -a

在搭建好的 resourceHA的環境下, 配置yarn

yarn是 hadoop2以後的計算框架,

技術分享

通過ResourceManager的調用, 將我們寫的程序包分到各個nodeManager上, 由於hadoop的理念是移動計算, 所以NodeManager和 DataNode是同一個機器

在 ${hadoop_home}/etc/hadoop 下

vim yarn-site.xml

<configuration>

 <property>
    <name>yarn.resourcemanager.ha.enabled</name>
    <value>true
</value> </property> <property> <name>yarn.resourcemanager.cluster-id</name> <value>yarncluster</value> </property> <property> <name>yarn.resourcemanager.ha.rm-ids</name> <value>rm1,rm2</value> </property> <property> <name>yarn.resourcemanager.hostname.rm1</name> <value>192.168
.208.106</value> </property> <property> <name>yarn.resourcemanager.hostname.rm2</name> <value>192.168.208.107</value> </property> <property> <name>yarn.resourcemanager.zk-address</name> <value>192.168.208.106:2181,192.168
.208.107:2181,192.168.208.108:2181</value> </property> <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> </configuration>

然後 vim mapred-site.xml

<configuration>
    <property>
       <name>mapreduce.framework.name</name>
       <value>yarn</value>
    </property>
</configuration>

17-hadoop-yarn安裝