Revise YARN resource assignment based on user feedback.
The processing capacity of the cluster is determined by the capacity given to YARN. In our case, both Map Reduce as well as Spark is running using YARN.
- Node Manager Capacity
- Container Capacity
- Map Reduce – Map Task and Reduce Task Capacity
- Spark – Executores Capacity
As the learning objective is primarily about YARN Resource Management, let us review the important properties with respect to YARN and see how the changes will reflect in Resource Manager Web UI.
https://gist.github.com/dgadiraju/e8b8687e00a8b43087348068e536c18d
Let us review this article about how properties should be configured for Resource Management.