Kettle database connection - Generic database connection hive (CDH version)

Version: kettle7.1, hive-common-1.1.0-cdh5.5.0

Table of contents

1. Create a connection

2、org/apache/thrift/TException

3、org.apache.hadoop.conf.Configuration

---

1. Create a connection

When we want to connect to hive through jdbc, we can configure a general data connection Generic database and copy the driver package to libswt/linux/x86_64.

 

2、org/apache/thrift/TException

If an error is reported:

2023/06/26 10:55:59 - 表输入.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : An error occurred, processing will be stopp
ed: 
2023/06/26 10:55:59 - 表输入.0 - Error occurred while trying to connect to the database
2023/06/26 10:55:59 - 表输入.0 - 
2023/06/26 10:55:59 - 表输入.0 - Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
2023/06/26 10:55:59 - 表输入.0 - org/apache/thrift/TException

It is because the version of the driver package is wrong, because we are connected to hive of cdh, so we need to copy the driver package of hive in the CDH cluster directory, usually in CDH/jars/hive-jdbc-1.1.0-cdh5.5.0-standalone. jar

3、org.apache.hadoop.conf.Configuration

If an error is reported:

2023/06/26 11:02:57 - 表输入.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : An error occurred, processing will be stopp
ed: 
2023/06/26 11:02:57 - 表输入.0 - Error occurred while trying to connect to the database
2023/06/26 11:02:57 - 表输入.0 - 
2023/06/26 11:02:57 - 表输入.0 - Error connecting to database: (using class org.apache.hive.jdbc.HiveDriver)
2023/06/26 11:02:57 - 表输入.0 - org/apache/hadoop/conf/Configuration

The wrong package is due to the lack of hadoop-common package, just copy hadoop-common-2.6.0-cdh5.5.0.jar in the CDH directory.