Hadoop的进程汇总

本文大数据环境CDH5,搭建步骤:https://blog.csdn.net/songzehao/article/details/91044032

基于此环境,对Hadoop中的进程进行梳理。

 主节点jps查看java进程:

 主节点查看python进程(Hue是python进程):

 Cloudera Manager查看主节点进程:

 与jps和ps -aux|grep HuePID的结果一一对应,表格中的进程按照CDH环境启动顺序:

Stage

PID

PName

belong

comment

MEM cost

启动界面服务,便于管理集群

8674

Main

N/A

service cloudera-scm-server start启动cdh界面和相关服务

1.5G

通过界面启动cloudera-management-service

9281

Main

N/A

Service Monitor

2.2G

9323

EventCatcherService

N/A

Event Service

9403

Main

N/A

Host Monitor

9468

AlertPublisher

N/A

Alert Publisher

通过界面启动hadoop各组件(启动后真正使用集群执行作业时,可能会多别的组件,如YARN的ApplicationMaster等等,当然还有未安装的HBase、Kafka等等)

10438

QuorumPeerMain

ZooKeeper

ZooKeeper Server

2.4G

10565

DataNode

HDFS

DataNode

10607

SecondaryNameNode

SecondaryNameNode

10677

NameNode

NameNode

11184

NodeManager

YARN

NodeManager

11302

JobHistoryServer

JobHistoryServer

11712

ResourceManager

ResourceManager

12098

RunJar

Hive

HiveServer2

12222

RunJar

Hive Metastore Server

12975

Bootstrap

Oozie

Oozie Server

13334

runcherrypyserver

Hue

Hue Server,python进程

发布了62 篇原创文章 · 获赞 22 · 访问量 7万+

猜你喜欢

转载自blog.csdn.net/songzehao/article/details/94619233