Perform OS-level Configuration

Let us see the OS-level Configuration for Hadoop Installation.

• Click here for more details about OS-level Configuration details.
• We can also run Host Inspection and review any warnings and take necessary actions.
• We will disable swappiness and transparent huge page compaction.

Disable Swappiness

Let us see how we can disable swappiness.

• Run sysctl vm.swappiness=0 on all the hosts
• Copy /etc/sysctl.conf to /home/itversity/setup_cluster/files/etc
• Synchronize on to all the servers using ansible. This will make sure that swappiness is disabled on reboots.

https://gist.github.com/dgadiraju/ca1013077b1805ee2525ca574f06ce7e

Disable Transparent Huge Page Compaction

Let us see how we can disable Huge Page Compaction.

• Update both the files as per the recommended commands by Host inspector.
• Also copy /etc/rc.local to /home/itversity/setup_cluster/files/etc and then add the commands into that file.

https://gist.github.com/dgadiraju/764379cc136e1e16c3f2ed81b31ec7e3