Private: HDP Certified Spark Developer (HDPCSD) – Scala

Overview of Big Data eco system
8 Topics
Overview about Ambari and HDFS
HDFS Architecture and Commands
Details about HDFS Commands
Overview about YARN
Yet Another Resource Negotiator (YARN)
YARN Scheduling and Hive Overview
Overview of Spark using Scala and Python
Overview of Pig and Data ingestion tools
Basics of programming using Scala
10 Topics
Getting Started – Scala
Basic Programming Constructs – Scala
Developing Functions and Arguments
Functions and Standard Operators
Functions Continued and Overview Of Collections
Processing Collections using Loops
Processing Collections using Loops and Map Reduce
Processing Collections using Map Reduce APIs
Developing Scala applications using IDE
Externalizing Properties in Scala Applications
Apache Spark 2 – Core APIs
5 Topics
Write a Spark Core application in Scala
Initialize a Spark application
Quick Recap of Scala
Spark 2.3.x Overview
Spark Development and Execution life cycle
Apache Spark 2 – Data Frames and Spark SQL
8 Topics
Spark Data Frames and Data Sets – Getting Started
Spark Data Frames and Data Sets – Overview of APIs
Data Frame Operations – Select Clause and Functions
Data Frame Operations – Basic Transformations
Data Frame Operations – Analytic Functions
Data Frames – Integration with Hive and JDBC
Spark SQL – Basic Transformations
Spark SQL – Analytics or Windowing Functions
Apache Spark 2 – Streaming
2 Topics
Spark Streaming (legacy) – Overview
Spark Structured Streaming – Overview
Revision for Exam
Previous Topic
Next Topic

Functions Continued and Overview Of Collections

Private: HDP Certified Spark Developer (HDPCSD) – Scala Basics of programming using Scala Functions Continued and Overview Of Collections

As part of this topic we have seen

  • User defined functions
  • Higher order and anonymous functions
  • Overview about collections – List, Set and Map
  • APIs on top of collections
  • and more

Previous Topic
Back to Lesson
Next Topic