Revise YARN resource assignment based on user feedback.
The processing capacity of the cluster is determined by the capacity given to YARN. In our case, both Map Reduce as well as Spark is running using YARN.
- Node Manager Capacity
- Container Capacity
- Map Reduce – Map Task and Reduce Task Capacity
- Spark – Executores Capacity
As the learning objective is primarily about YARN Resource Management, let us review the important properties with respect to YARN and see how the changes will reflect in Resource Manager Web UI.
Let us review this article about how properties should be configured for Resource Management.