CDH报错:Resource management is disabled for host cdh03 but at least one of its roles has cgroup parame

问题描述

Resource management is disabled for host cdh03 but at least one of its roles has cgroup parame

问题解决

(1)CDH进入YARN配置页面,搜索 cgroup ,将以下两个选项配置勾选

将 CGroups 用于资源管理  yarn.nodemanager.linux-container-executor.resources-handler.class

始终使用 Linux Container Executor  yarn.nodemanager.container-executor.class

(2)开启后保存时发现需要启用Cgroup 资源管理配置

(3)couldear主界面点击 主机 - 所有主机 ,然后点击每一台服务器

 (4)进入配置选项,找到 "启用基于 Cgroup 的资源管理" 选项,勾选 - 保存 - (每一台主机)

官方说明

Configuration Name Description
yarn.nodemanager.container-executor.class This should be set to “org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor”. CGroups is a Linux kernel feature and is exposed via the LinuxContainerExecutor.
yarn.nodemanager.linux-container-executor.resources-handler.class This should be set to “org.apache.hadoop.yarn.server.nodemanager.util.CgroupsLCEResourcesHandler”. Using the LinuxContainerExecutor doesn’t force you to use CGroups. If you wish to use CGroups, the resource-handler-class must be set to CGroupsLCEResourceHandler.

问题总结

Cgroup 是Linux 提供给一组进程及将来子进程的资源(CPU、内存、存储、网络)限制、控制和统计的能力。

配置上文的两个YARN选项可以将Cgroup权限交由给Yarn管理,Yarn可以更灵活的调用Linux资源。

原创文章 165 获赞 92 访问量 7万+

猜你喜欢

转载自blog.csdn.net/qq262593421/article/details/105761924