hadoop-企业版环境搭建(三)-mapreduce和yarn的安装

版权声明:本文为博主原创文章,未经博主允许不得转载。 https://blog.csdn.net/shursulei/article/details/78168837

mapreduce和yarn的安装

  • yarn-site.xml文件的配置
<configuration>
<property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>##
<property>
   <name>yarn.resourcemanager.ha.enabled</name>
   <value>true</value>
 </property>
 <property>
   <name>yarn.resourcemanager.cluster-id</name>
   <value>sulei</value>
 </property>
 <property>
   <name>yarn.resourcemanager.ha.rm-ids</name>
   <value>rm1,rm2</value>
 </property>
 <property>
   <name>yarn.resourcemanager.hostname.rm1</name>
   <value>node1</value>
 </property>
 <property>
   <name>yarn.resourcemanager.hostname.rm2</name>
   <value>node4</value>
 </property>
 <property>
   <name>yarn.resourcemanager.zk-address</name>
   <value>node1:2181,node2:2181,node3:2181</value>
 </property>
</configuration>
  • mapred-site.xml文件的配置
[root@node1 hadoop]# mv mapred-site.xml.template mapred-site.xml
[root@node1 hadoop]# vi mapred-site.xml 
<property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
    ##此处不需要配置nodemanger
 copy到其他几点
[root@node1 hadoop]# scp ./* root@node2:/home/hadoop-2.5.1/etc/hadoop/
[root@node1 hadoop]# scp ./* root@node3:/home/hadoop-2.5.1/etc/hadoop/
[root@node1 hadoop]# scp ./* root@node4:/home/hadoop-2.5.1/etc/hadoop/
  • 启动
[root@node1 hadoop]# start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /home/hadoop-2.5.1/logs/yarn-root-resourcemanager-node1.out
node2: starting nodemanager, logging to /home/hadoop-2.5.1/logs/yarn-root-nodemanager-node2.out
node3: starting nodemanager, logging to /home/hadoop-2.5.1/logs/yarn-root-nodemanager-node3.out
node4: starting nodemanager, logging to /home/hadoop-2.5.1/logs/yarn-root-nodemanager-node4.out
node4的resourcemanager需要手动启动
[root@node4 .ssh]# yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /home/hadoop-2.5.1/logs/yarn-root-resourcemanager-node4.out
##重定向到node1上去

猜你喜欢

转载自blog.csdn.net/shursulei/article/details/78168837