Let us see how we can add the new node as a worker to the cluster. Worker Components: HDFS Datanode YARN Node Manager HBase Region Server Impala Impalad To add a node as HDFS Datanode, we need to have additional storage devices mounted and formatted. https://gist.github.com/dgadiraju/55d5c81b319748502bfcfab78f3602d5 Once the node is formatted, either we can use …
Let us see how to add a new node to an existing cluster. Provision the server and make sure passwordless login is setup. If you are using Ansible, make sure it is added to the hosts file in appropriate host groups. Make sure there is passwordless login enabled between the server on which Cloudera Manager …
Let us talk about how we can setup CDH on the cluster. We have installed CDH using Packages and then migrated to Parcels. If we want to setup cluster with Parcels directly, steps are not significantly different, except for one page where it prompts us to use Packages or Parcels. Once the cluster is set …
Let us discuss details about installing Cloudera Manager Server and Agents. Cloudera Manager Server will be running on one of the hosts in the cluster, while Agents need to run on all the hosts in the cluster. Cloudera Manager Server and Agents together facilitate us to easily set up CDH on the cluster as well …
Let us see the OS-level Configuration for Hadoop Installation. Click here for more details about OS-level Configuration details. We can also run Host Inspection and review any warnings and take necessary actions. We will disable swappiness and transparent huge page compaction. Disable Swappiness Let us see how we can disable swappiness. Run sysctl vm.swappiness=0 on …
Here are the high-level details to set up a local CDH Repository. We can install CDH directly from public repositories. However, it is not a good idea to use public repositories directly while using Packages. Network Intensive Behind the Firewall We will facilitate only one host to connect to public repositories. Parcels – Server on …
