hadoop2.x伪分布式安装

版权声明：本文为博主原创文章，未经博主允许不得转载。 https://blog.csdn.net/qq_35744460/article/details/89046718

hadoop环境变量

[hadoop@hadoop001 app]$ vi ~/.bash_profile 
export HADOOP_HOME=/home/hadoop/app/hadoop-2.6.0-cdh5.7.0
export PATH=$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$FINDBUGS_HOME/bin:$PROTOBUF_HOME/bin:$MAVEN_HOME/bin:$JAVA_HOME/bin:$PATH
[hadoop@hadoop001 app]$ source ~/.bash_profile 
[hadoop@hadoop001 app]$ hadoop version
Hadoop 2.6.0-cdh5.7.0

hadoop文件配置

[hadoop@hadoop001 hadoop]$ cd etc/hadoop/
[hadoop@hadoop001 hadoop]$ vi hadoop-env.sh 
export JAVA_HOME=/usr/java/jdk1.8.0_45

这需要指定具体java_home

1. core-site.xml

   [hadoop@hadoop001 hadoop]$ vi core-site.xml

<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://hadoop001:8020</value>
    </property>
</configuration>

2. hdfs-site.xml

[hadoop@hadoop001 hadoop]$ vi hdfs-site.xml

 <configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
</configuration>

3. yarn-site.xml

<configuration>
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
</configuration>

4. mapred-site.xml
   [hadoop@hadoop001 hadoop]$ vi mapred-site.xml

<configuration>
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
</configuration>

5. slaves
   输入hadoop001

启动

1. 先格式化

    [hadoop@hadoop001 hadoop]$ hdfs namenode -format
    19/04/05 10:45:40 INFO common.Storage: Storage directory /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/data/dfs/name has been successfully formatted.

2. 全部启动

    [hadoop@hadoop001 sbin]$ start-all.sh 
    This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
    Starting namenodes on [hadoop001]
    hadoop001: starting namenode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/hadoop-hadoop-namenode-hadoop001.out
    hadoop001: starting datanode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/hadoop-hadoop-datanode-hadoop001.out
    Starting secondary namenodes [0.0.0.0]
    0.0.0.0: starting secondarynamenode, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/hadoop-hadoop-secondarynamenode-hadoop001.out
    starting yarn daemons
    starting resourcemanager, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/yarn-hadoop-resourcemanager-hadoop001.out
    hadoop001: starting nodemanager, logging to /home/hadoop/app/hadoop-2.6.0-cdh5.7.0/logs/yarn-hadoop-nodemanager-hadoop001.out
    [hadoop@hadoop001 sbin]$ jps
    24864 ResourceManager
    24723 SecondaryNameNode
    24565 DataNode
    24954 NodeManager
    24443 NameNode
    25165 Jps

启动成功

3. 关闭防火墙（centos 7.3）

    [root@hadoop001 ~]# firewall-cmd --state   (查看状态)
    running
    [root@hadoop001 ~]# systemctl stop firewalld.service （关闭）
    [root@hadoop001 ~]# systemctl disable firewalld.service （关闭开机启动）
    Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
    Removed symlink /etc/systemd/system/basic.target.wants/firewalld.service.
    访问 hdfs web
    hadoop001:50070
    访问 yarn
    hadoop001:8088

结尾

本文是根据上篇编译好的进行安装的，详细介绍点击下面链接
上篇支持压缩编译地址