Oss文件与Os及hdfs交互

版权声明：本文为博主原创文章，未经博主允许不得转载。 https://blog.csdn.net/BabyFish13/article/details/82852579

1、文件从oss上下载到本地

hadoop fs -copyToLocal oss://{AccessKeyId}:{AccessKeySecret}@chushou-srv-log.oss-cn-shenzhen-internal.aliyuncs.com/tmp/nisj/Mysql2Hive.zip

2、文件从本地上传到oss

hadoop fs -copyFromLocal /home/hadoop/nisj/0820cc.txt oss://{AccessKeyId}:{AccessKeySecret}@chushou-srv-log.oss-cn-shenzhen-internal.aliyuncs.com/tmp/nisj/0820cc.txt

3、文件从oss下载到hdfs

hadoop distcp oss://%s:%s@%s.%s/%s hdfs:%s""" % (AccessKeyId, AccessKeySecret, bucket, endpoint, ossFileName, hdfsFileName)