HDFS读写文件中涉及到的几个思想

1.网络拓扑–节点距离计算

1.节点距离:两个节点到达最近的共同祖先的距离总和。
2.图解:
在这里插入图片描述

2.机架感知(副本节点选择)

1.官方说明:http://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html#Data_Replication

关键句:
For the common case, when the replication factor is three, HDFS’s placement policy is to put one replica on one node in the local rack, 
another on a different node in the local rack, and the last on a different node in a different rack.

2.图解:
在这里插入图片描述

版权声明:本博客为记录本人自学感悟,转载需注明出处!
https://me.csdn.net/qq_39657909

猜你喜欢

转载自blog.csdn.net/qq_39657909/article/details/85056260