1、
[Flume] implementation of flume output sink to hbase
2、
Blood lessons! To test flume, you must first look at the first line of errors! It outputs the error message in the form of stack...
3、
sqoop2 does not support the command line, and the jar package of sqoop1.4.x is missing from the lib of sqoop1
4、
--null-string '\\N' --null-non-string '\\N' sqoop import and export null value processing
It doesn't matter
that the management node statement is not correct
. There are many problems with distributed systems. There are two of them
. 1. Coordination
2. Resource Management
Zookeeper focuses on solving the former,
Yarn focuses on solving the latter.
that the management node statement is not correct
. There are many problems with distributed systems. There are two of them
. 1. Coordination
2. Resource Management
Zookeeper focuses on solving the former,
Yarn focuses on solving the latter.
YARN is equivalent to the government, which is responsible for managing the allocation of machine resources. If you have difficulty finding the government, the government will arrange human and material resources to solve your problems. This is the management node you are talking about.
Zookeeper is the equivalent of the Legislative Council, whose goal is to provide authoritative information to all people in the country. Zookeeper is mainly concerned with the consistency of information, managing some information that needs to be consistent in everyone's mind. Although it is often used to manage information about which node is alive, which node is dead, or which node is responsible for what, it is still the department mainly responsible for managing information (files, laws), not the people's livelihood department...
Zookeeper is the equivalent of the Legislative Council, whose goal is to provide authoritative information to all people in the country. Zookeeper is mainly concerned with the consistency of information, managing some information that needs to be consistent in everyone's mind. Although it is often used to manage information about which node is alive, which node is dead, or which node is responsible for what, it is still the department mainly responsible for managing information (files, laws), not the people's livelihood department...
6、
namenode secondlynamenode cannot switch one is down, and the other is standby because the relative path is written in the ssh configuration path
<property>
<name>dfs.ha.fencing.ssh.private-key-files</name>
<value>/home/grid/.ssh/id_rsa</value>
</property>
But I did not change the path of the slave, when uploading data later
There is no problem with viewing the data
7.
Kafka is a consumer and directly took the data, resulting in spark steaming unable to read