Apache Spark 學習紀錄
  • Introduction
  • Spark architecture
    • spark架構圖
  • Launch a Spark program
    • Spark-submit
    • Spark-shell
    • pyspark
  • RDD
  • DataFrame
  • SparkSQL
  • Spark Streaming
  • 性能調校
Powered by GitBook
On this page

Was this helpful?

Spark architecture

PreviousIntroductionNextspark架構圖

Last updated 5 years ago

Was this helpful?

在下一頁我們可以看到 Spark 的架構圖

而後依序不同章節針對 Spark 整個系統的重要元素做介紹。

  1. spark 底層架構

  2. Launch a Spark program

  3. RDD

  4. DataFrame

  5. SparkSQL

  6. Spark Streaming

  7. 最後再講解一下性能調教跟實作

Reference :

https://spark.apache.org/docs/2.3.0/api/java/index.html?org/apache/spark/sql/Dataset.html
https://spark.apache.org/docs/2.2.0/index.html
http://spark.apache.org/docs/2.1.0/api/python/index.html