mapreduce included running bug

In 8088 the port can see the log files (mainly to see the error), as follows:

 

 

 

 

 

 

1.window jdk version of the best and consistent linux jdk version, otherwise prone to bug

2. when there class not found, the need to export src jar package file, the code was added in the main function is as follows:

 

 

3. If the return value bug 1, possibly mapred-default.xml, yarn-default.xml did not increase following parameters (can be added at the end):

<property>
    <name>mapreduce.application.classpath</name>
    <value>
        $HADOOP_CONF_DIR,
        $HADOOP_COMMON_HOME/share/hadoop/common/*,
        $HADOOP_COMMON_HOME/share/hadoop/common/lib/*,
        $HADOOP_HDFS_HOME/share/hadoop/hdfs/*,
        $HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,
        $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*,
                
        $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*,
        $HADOOP_YARN_HOME/share/hadoop/yarn/*,
        $HADOOP_YARN_HOME/share/hadoop/yarn/lib/*
    </value>
</property>

(The files are in hadoop-mapreduce-client-core-2.8.5.jar, hadoop-yarn-api-2.8.5.jar in)

Note: These two have to first jar package remove bulid Path, before you can modify the .xml file

 

Guess you like

Origin www.cnblogs.com/ldy233/p/11479678.html