org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_

错误日志:
org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1574002486205_0004 failed 2 times due to AM Container for appattempt_1574002486205_0004_000002 exited with exitCode: -103
For more detailed output, check application tracking page:http://cts01:8088/cluster/app/application_1574002486205_0004Then, click on links to logs of each attempt.
Diagnostics: Container [pid=4082,containerID=container_1574002486205_0004_02_000001] is running beyond virtual memory limits. Current usage: 89.9 MB of 1 GB physical memory used; 2.6 GB of 2.1 GB virtual memory used. Killing container.
Dump of the process-tree for container_1574002486205_0004_02_000001 :
|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE
|- 4137 4082 4082 4082 (java) 275 23 2636447744 22667 /root/modules/jdk/bin/java -Xmx819m -Djava.io.tmpdir=/root/modules/hadoop/data/tmp/nm-local-dir/usercache/root/appcache/application_1574002486205_0004/container_1574002486205_0004_02_000001/tmp -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=/root/modules/hadoop/logs/userlogs/application_1574002486205_0004/container_1574002486205_0004_02_000001 -Dtez.root.logger=INFO,CLA -Dsun.nio.ch.bugLevel= org.apache.tez.dag.app.DAGAppMaster --session
|- 4082 4081 4082 4082 (bash) 0 1 115896320 352 /bin/bash -c /root/modules/jdk/bin/java -Xmx819m -Djava.io.tmpdir=/root/modules/hadoop/data/tmp/nm-local-dir/usercache/root/appcache/application_1574002486205_0004/container_1574002486205_0004_02_000001/tmp -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=/root/modules/hadoop/logs/userlogs/application_1574002486205_0004/container_1574002486205_0004_02_000001 -Dtez.root.logger=INFO,CLA -Dsun.nio.ch.bugLevel=’’ org.apache.tez.dag.app.DAGAppMaster --session 1>/root/modules/hadoop/logs/userlogs/application_1574002486205_0004/container_1574002486205_0004_02_000001/stdout 2>/root/modules/hadoop/logs/userlogs/application_1574002486205_0004/container_1574002486205_0004_02_000001/stderr
解决方法:

<property>
   <name>yarn.scheduler.minimum-allocation-mb</name>
   <value>2048</value>
   <description>default value is 1024</description>
</property>
<property>
    <name>yarn.nodemanager.vmem-pmem-ratio</name>
    <value>2.1</value>
    <description>default value is 2.1</description>
</property>

猜你喜欢

转载自blog.csdn.net/w13716207404/article/details/103115816