转载:
hadoop-2.5.0源码编译
第一步:解压hadoop-2.5.0-src.tar.gz至/opt/modules/目录下
[qianxin@hadoop-master hadoop-2.5.0]$ tar -zxvf /opt/softwares/hadoop-2.5.0-src.tzr.gz -C /opt/modules
[qianxin@hadoop-master hadoop-2.5.0]$ tar -zxvf /opt/softwares/jdk-7u67-linux-x64.tar.gz -C /opt/modules
第三步:配置java环境变量
export JAVA_HOME=/opt/modules/jdk1.7.0_67 export JRE_HOME=$JAVA_HOME/jre export PATH=$PATH:$JAVA_HOME/bin:JRE_HOME/bin
[root@hadoop-master hadoop-2.5.0]# source /etc/profile [root@hadoop-master hadoop-2.5.0]# su - qianxin [qianxin@hadoop-master hadoop-2.5.0]$ java -version java version "1.7.0_67" Java(TM) SE Runtime Environment (build 1.7.0_67-b01) Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)
第四步:安装MAVEN、配置MAVEN环境变量
[qianxin@hadoop-master hadoop-2.5.0]$ tar -zxvf /opt/softwares/apache-maven-3.0.5-bin.tar.gz -C /opt/modules [qianxin@hadoop-master hadoop-2.5.0]$ su - root [root@hadoop-master hadoop-2.5.0]# vi /etc/profile [root@hadoop-master hadoop-2.5.0]# source /etc/profile [root@hadoop-master hadoop-2.5.0]# su - qianxin [qianxin@hadoop-master hadoop-2.5.0]$ mvn -version Apache Maven 3.0.5 (r01de14724cdef164cd33c7c8c2fe155faf9602da; 2013-02-19 21:51:28+0800) Maven home: /opt/modules/apache-maven-3.0.5 Java version: 1.7.0_67, vendor: Oracle Corporation Java home: /opt/modules/jdk1.7.0_67/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "2.6.32-431.el6.x86_64", arch: "amd64", family: "unix"
第五步:安装gcc/gcc-c++/make
[qianxin@hadoop-master hadoop-2.5.0]$ su - root [root@hadoop-master hadoop-2.5.0]# yum -y install gcc gcc-c++ [root@hadoop-master hadoop-2.5.0]# yum install make
第六步:解压安装protobuf
[qianxin@hadoop-master hadoop-2.5.0]$ tar -zxvf protobuf-2.5.0.tar.gz -C /opt/modules/ [qianxin@hadoop-master hadoop-2.5.0]$ cd /opt/modules/protobuf-2.5.0/ [qianxin@hadoop-master protobuf-2.5.0]$ ./configure --prefix=/usr/local/protoc [qianxin@hadoop-master protobuf-2.5.0]$ make [qianxin@hadoop-master protobuf-2.5.0]$ su - root [root@hadoop-master ~]# cd /opt/modules/protobuf-2.5.0 [root@hadoop-master protobuf-2.5.0]# make install
第七步:配置protobuf环境变量
[qianxin@hadoop-master hadoop-2.5.0]$ sudo vim /etc/profile [qianxin@hadoop-master hadoop-2.5.0]$ su - root [root@hadoop-master ~]# source /etc/profile [root@hadoop-master ~]# su - qianxin [qianxin@hadoop-master hadoop-2.5.0]$ protoc --version libprotoc 2.5.0
第八步:下载安装CMake、openssl、ncurses
[qianxin@hadoop-master ~]$ su - root [root@hadoop-master ~]# yum install cmake [root@hadoop-master ~]# yum install openssl-devel [root@hadoop-master ~]# yum install ncurses-devel
第九步:添加配置镜像
路径:/opt/modules/apache-maven-3.0.5/conf/setting.xml
第十步:开始编译hadoop源码包
[qianxin@hadoop-master ~]$ cd /opt/modules/hadoop-2.5.0-src/ [qianxin@hadoop-master ~]$ mvn package -DskipTests -Pdist,native
等待10分钟左右,即可看到以下编译成功的信息:
用编译后/opt/modules/hadoop-2.5.0-src/hadoop-dist/target/hadoop-2.5.0/lib目录下新的native文件夹,替换/opt/modules/hadoop-2.5.0/lib目录下旧的native文件夹即可解决执行hdfs相关命令时报的警告: