sqoop增量数据导入hive表的方法

数据表的创建样例:
CREATE TABLE `YDDT` (
  `ID` string,
  `YDJC_ID` string,
  `YDDT_DATA_TYPE` string,
  `YDDT_BUSSINESS_NOW` bigint,
  `YDDT_USER_NOW` bigint,
  `YDDT_COLLECT_TIME` string,
  `YDDT_CREATOR` string,
  `YDDT_DATE` string,
  `BACK` string

)row format delimited fields terminated by '\t';


数据表的增量导入样例:
sqoop import --append --connect jdbc:mysql://172.20.13.50:3306/TestBigDate --username root --password 123456  --table YDDT_2017_01_16 -m 3 --target-dir /user/hive/warehouse/yddt --fields-terminated-by '\t'


针对的集群版本 :

hdoop:2.7.2

hive:2.1.1

sqoop:1.4.6

猜你喜欢

转载自blog.csdn.net/weibin_6388/article/details/78123503