Section 4 :25.Understanding yarn and map reduce configuration properties

In Hadoop, the configuration properties for YARN and MapReduce are set in XML files. Here are some of the key XML files and their corresponding configuration properties for YARN and MapReduce:

1. yarn-site.xml: This file contains the configuration properties for YARN. Some of the key properties that can be set in this file are:

• yarn.resourcemanager.hostname: This property specifies the hostname of the YARN ResourceManager.
• yarn.nodemanager.resource.memory-mb: This property specifies the maximum amount of memory that can be used by a YARN NodeManager.
• yarn.scheduler.minimum-allocation-mb: This property specifies the minimum amount of memory that can be allocated to a YARN container.

2. mapred-site.xml: This file contains the configuration properties for MapReduce. Some of the key properties that can be set in this file are:

• mapreduce.framework.name: This property specifies the framework used for MapReduce processing. The default value is “yarn”.
• mapreduce.map.memory.mb: This property specifies the amount of memory that can be used by a MapReduce mapper.
• mapreduce.reduce.memory.mb: This property specifies the amount of memory that can be used by a MapReduce reducer.