本文大数据环境CDH5,搭建步骤:https://blog.csdn.net/songzehao/article/details/91044032
基于此环境,对Hadoop中的进程进行梳理。
主节点jps查看java进程:
主节点查看python进程(Hue是python进程):
Cloudera Manager查看主节点进程:
与jps和ps -aux|grep HuePID的结果一一对应,表格中的进程按照CDH环境启动顺序:
Stage |
PID |
PName |
belong |
comment |
MEM cost |
启动界面服务,便于管理集群 |
8674 |
Main |
N/A |
service cloudera-scm-server start启动cdh界面和相关服务 |
1.5G |
通过界面启动cloudera-management-service |
9281 |
Main |
N/A |
Service Monitor |
2.2G |
9323 |
EventCatcherService |
N/A |
Event Service |
||
9403 |
Main |
N/A |
Host Monitor |
||
9468 |
AlertPublisher |
N/A |
Alert Publisher |
||
通过界面启动hadoop各组件(启动后真正使用集群执行作业时,可能会多别的组件,如YARN的ApplicationMaster等等,当然还有未安装的HBase、Kafka等等) |
10438 |
QuorumPeerMain |
ZooKeeper |
ZooKeeper Server |
2.4G |
10565 |
DataNode |
HDFS |
DataNode |
||
10607 |
SecondaryNameNode |
SecondaryNameNode |
|||
10677 |
NameNode |
NameNode |
|||
11184 |
NodeManager |
YARN |
NodeManager |
||
11302 |
JobHistoryServer |
JobHistoryServer |
|||
11712 |
ResourceManager |
ResourceManager |
|||
12098 |
RunJar |
Hive |
HiveServer2 |
||
12222 |
RunJar |
Hive Metastore Server |
|||
12975 |
Bootstrap |
Oozie |
Oozie Server |
||
13334 |
runcherrypyserver |
Hue |
Hue Server,python进程 |