Day: February 17, 2023

Let us review the details related to setting up of Spark Environment. We have already covered how to set up the environment earlier. • Pre-requisites 64 bit Computer At least 4 GB RAM and enough storage 64-bit Operating System – Windows 10, Linux, Mac etc. We would recommend Ubuntu on top of Windows 10. You …

Setup Spark Environment Read More »

As part of this topic, we will review setup steps of Spark, understand different modules, Spark Architecture and how it is mapped to different execution modes such as YARN, Mesos etc. Spark is nothing but a distributed computing framework. To leverage the framework we need to learn APIs categorized into different modules and build applications …

Apache Spark – Getting Started Read More »