Apache Spark 2 – Core APIs

As part of this lesson we will see how to build scaleable applications using Spark APIs with Scala as programming language.

  • Setup Development Environment – Scala and Spark
  • Spark Architecture
  • Spark Data Structures such as RDD, Data Frames, Data Sets etc
  • Data Frames and Data Frame Operations
  • Spark SQL
  • and more

We have not only covered basic transformations such as filtering, joins, aggregations but also analytics/windowing functions are covered in detail.

Week 1 Sessions (only related to Spark)

Week 2 Sessions

Week 3 Sessions

As the video is not streamed to YouTube, content is updated with shorter videos in the below section.

Data Frame Operations – Select Clause and Functions

Week 4 Sessions