Perform OS-level Configuration

Let us see the OS-level Configuration for Hadoop Installation.

  • Click here for more details about OS-level Configuration details.
  • We can also run Host Inspection and review any warnings and take necessary actions.
  • We will disable swappiness and transparent huge page compaction.

Disable Swappiness

Let us see how we can disable swappiness.

  • Run sysctl vm.swappiness=0 on all the hosts
  • Copy /etc/sysctl.conf to /home/itversity/setup_cluster/files/etc
  • Synchronize on to all the servers using ansible. This will make sure that swappiness is disabled on reboots.

https://gist.github.com/dgadiraju/ca1013077b1805ee2525ca574f06ce7e

Disable Transparent Huge Page Compaction

Let us see how we can disable Huge Page Compaction.

  • Update both the files as per the recommended commands by Host inspector.
  • Also copy /etc/rc.local to /home/itversity/setup_cluster/files/etc and then add the commands into that file.

https://gist.github.com/dgadiraju/764379cc136e1e16c3f2ed81b31ec7e3

Share this post