X-Pack Spark User Manual

Outline

Spark is a general-purpose computing platform Big Data platform is widely used. This paper describes the knowledge related to the Spark, including: understanding Spark, Spark use, problems encountered in the process of using the Spark FAQ, etc., would like to help users to quickly grasp how to use Spark and Spark.
X-Pack Spar compatible open source Spark, in the material in this article to X-Pack Spark background.

Outline

1. Getting introduced Spark
   * Spark local connection hbase cluster for debugging .
2. Spark Streaming presentation (to be improved)
3. Spark SQL introduction (to be improved)
4. Structured Streaming presentation (to be improved)

5. Case Study (to be improved)

   1. Advertising Hits real-time statistics: Spark StructuredStreaming + Redis Streams
   2. SparkSQL in practice there is praise
   3. Spark practice game Big Data + HBase .

6. FAQ

   1. How to analyze the use of YarnUI, SparkUI, Spark log, task operating conditions .