Apache Spark 2 – Core APIs
As part of this lesson we will see how to build scaleable applications using Spark APIs with Scala as programming language.
- Setup Development Environment – Scala and Spark
- Spark Architecture
- Spark Data Structures such as RDD, Data Frames, Data Sets etc
- Data Frames and Data Frame Operations
- Spark SQL
- and more
We have not only covered basic transformations such as filtering, joins, aggregations but also analytics/windowing functions are covered in detail.
Week 1 Sessions (only related to Spark)
Week 2 Sessions
Week 3 Sessions
As the video is not streamed to YouTube, content is updated with shorter videos in the below section.
Data Frame Operations – Select Clause and Functions