sqoop运行时提示内存不足的解决办法

得知mapreduce的运行内存不足,主要为这一段
Diagnostics: Container [pid=13688,containerID=container_e07_1533215502568_0002_02_000001] is running beyond physical memory limits. Current usage: 180.2 MB of 170 MB physical memory used; 1.9 GB of 357.0 MB virtual memory used. Killing container.

在yarn.site 中设置 yarn.scheduler.minimum-allocation-mb 的值为256MB问题解决

yarn.scheduler.minimum-allocation-mb
256

如果提示虚拟内存不足,可以关闭检查,如下设置

yarn.nodemanager.vmem-check-enabled
false
Whether virtual memory limits will be enforced for containers.

猜你喜欢

转载自www.cnblogs.com/hupingzhi/p/12357541.html