Detailed explanation of the principles of Spark, HDFS, YARN, Zookeeper, Kafka, Hive, HBase, etc. - Code World

Detailed explanation of the principles of Spark, HDFS, YARN, Zookeeper, Kafka, Hive, HBase, etc.

Others 2021-01-26 19:13:30 views: null

NoSuchKey

Guess you like

Origin blog.csdn.net/zhengzaifeidelushang/article/details/112065395

Detailed explanation of the principles of Spark, HDFS, YARN, Zookeeper, Kafka, Hive, HBase, etc.

Detailed steps to build a big data environment (installation and configuration of Hadoop, Hive, Zookeeper, Kafka, Flume, Hbase, Spark, etc.)

Big Data common port summary -hadoop, hbase, hive, spark, kafka, zookeeper, etc. (continually updated)

Start command and web-ui-port hdfs/hadoop/spark/yarn/hive/hbase/storm/zookeeper/Hcatalog......

Detailed explanation of the underlying principles of Zookeeper

Big Data | The connection and difference between Hadoop, HDFS, HIVE, HBase, Spark

Detailed explanation of Spark Streaming based on kafka Direct

Detailed explanation of the two modes of Spark on yarn (this is very important)

Big Data platform to build: Hadoop-3.1.3 + Hive-3.1.2 + HBase-2.2.3 + Zookeeper-3.5.7 + Kafka_2.11-2.4.0 + Spark-2.4.5

spark_hive_to_hbase

2.4-2.5, Hive integration (integration Spark, integration Hbase), connection Cli, HiveServer and hivemetastore, Squirrel SQL Client etc.

Spark on Yarn Detailed

Detailed explanation of Kafka’s basic principles, execution processes and usage scenarios

HDFS Study Notes (5): Principles of Yarn Architecture

[Big Data] Spark reads data sources such as Hive/Hbase/Elasticsearch/Kafka/Mysql

java,mysql,hadoop,cdh,hive,spark,ntp,zookeeper,kafka,storm,redis,flume,git installation details

Linux virtual machine: building a basic environment for big data clusters (Hadoop, Spark, Flink, Hive, Zookeeper, Kafka, Nginx)

Detailed explanation of HDFS blocks

Detailed explanation of TCP principles

What is kafka, how to use (2) -? Containing zookeeper, etc.

Detailed explanation of ZooKeeper watchpoints

Detailed explanation of zookeeper configuration

Detailed explanation of order by in hive

Hive basics and detailed explanation

sqoop: mysql import data into hdfs, hive, hbase

Centos7+Hadoop2.7.7+Hive2.3.0+Hbase2.0.2+spark2.4+zookeeper3.4.10 builds a distributed big data cluster

Detailed database connection pool concepts, principles, operation mechanism, etc.

Detailed explanation of spark checkpoint

Big Data Hadoop Hive HBase Spark Storm

spark-streaming connect hive+HBase

Recommended

Ranking

go common records

SVN power failure recovery

深入理解Redis集群主从复制原理

【二叉树】左叶子之和

[1] The first basic syntax Detailed Kotlin

Linux Ansible creates tasks and executes them

vmware ubuntu virtual machine boots online courses

Use Nodejs to crawl certain data from the web page and write the crawled data into excel (see the next article for the front-end part and the server-side part)

Principle underlying thread pool

The number of bytes occupied when char[ ] is initialized

Daily

More

2025-03-22(0)

2025-03-21(0)

2025-03-20(0)

2025-03-19(0)

2025-03-18(0)

2025-03-17(0)

2025-03-16(0)

2025-03-15(0)

2025-03-14(0)

2025-03-13(0)