HiveServer2配置HA

版权声明：本文为博主原创文章，未经博主允许不得转载。 https://blog.csdn.net/yvigmmwfn/article/details/78679429

• 软件环境

  CentOS 6.8

  Hadoop 2.6.0-cdh5.9.0

  Hive 1.1.0-cdh5.9.0

  Zookeeper 3.4.5-cdh5.9.0

• 工作原理

常规连接

HiverServer HA

• 配置Hive HA
  

  前置条件先安装好Hadoop、Zookeeper
  
  vi $HIVE_HOME/conf/hive-site.xml
  
  添加配置如下:

<property>
<name>hive.server2.support.dynamic.service.discovery</name>
<value>true</value>
</property>
<property>
<name>hive.server2.zookeeper.namespace</name>
<value>hiveserver2_zk</value>
</property>
<property>
<name>hive.zookeeper.quorum</name>
<value>dw1:2181,dw2:2181,dw3:2181</value>
</property>
<property>
<name>hive.zookeeper.client.port</name>
<value>2181</value>
</property>
<property>
<name>hive.server2.thrift.bind.host</name>
<value>主机名(强烈建议使用主机名防止IP发生变化)</value>
</property>

• 启动HiveServer2

  $HIVE_HOME/bin/hiveserver2
  //默认端口为10000

• 检查Zookeeper注册

  登录Zookeeper对应的服务器

  执行zookeeper-client如下：

[zk: localhost:2181(CONNECTED) 0] ls /hiveserver2_zk
[serverUri=dw2:10000;version=1.1.0-cdh5.9.0;sequence=0000000006, serverUri=dw1:10000;version=1.1.0-cdh5.9.0;sequence=0000000007]
[zk: localhost:2181(CONNECTED) 1]

以上表示注册成功

• 连接hiveserver2
  

  连接字符串如下：

$HIVE_HOME/bin/beeline -u "jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2_zk" hadoop hadoop

连接成功信息如下：

hadoop@dw6:~$ $HIVE_HOME/bin/beeline -u "jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2_zk" hadoop hadoop
scan complete in 1ms
Connecting to jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2_zk
17/11/30 18:40:52 [main]: INFO jdbc.HiveConnection: Connected to dw1:10000
Connected to: Apache Hive (version 1.1.0-cdh5.9.0)
Driver: Hive JDBC (version 1.1.0-cdh5.9.0)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.1.0-cdh5.9.0 by Apache Hive
0: jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/de> show tables;
+----------------+--+
|    tab_name    |
+----------------+--+
| test_datediff  |
| web_logs       |
| web_logs_1     |
| web_logs_orc   |
| web_logs_text  |
+----------------+--+
5 rows selected (0.147 seconds)
0: jdbc:hive2://dw1:2181,dw2:2181,dw3:2181/de> 

• 文章参考

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_hadoop-ha/content/ch_HA-Hive.html
http://lxw1234.com/archives/2016/05/675.htm

---