Perform basic and advanced configuration needed to effectively administer a Hadoop cluster Configure a Service using Cloudera Manager Create an HDFS user’s home directory Configure NameNode HA Configure ResourceManager HA Configure proxy for Hiveserver2/Impala
We have added several services to our cluster using Cloudera Manager. Following are the services added as part of the demonstrations. Zookeeper Hadoop (HDFS and YARN with MR2) Spark and Spark 2 Hive and Impala Sqoop, Pig, Oozie and Hue HBase Kafka Here are the general guidelines to add any supported service. Understand Architecture – …
Let us see how we can add the new node as a worker to the cluster. Worker Components: HDFS Datanode YARN Node Manager HBase Region Server Impala Impalad To add a node as HDFS Datanode, we need to have additional storage devices mounted and formatted. https://gist.github.com/dgadiraju/55d5c81b319748502bfcfab78f3602d5 Once the node is formatted, either we can use …
Let us see how to add a new node to an existing cluster. Provision the server and make sure passwordless login is setup. If you are using Ansible, make sure it is added to the hosts file in appropriate host groups. Make sure there is passwordless login enabled between the server on which Cloudera Manager …
Let us talk about how we can setup CDH on the cluster. We have installed CDH using Packages and then migrated to Parcels. If we want to setup cluster with Parcels directly, steps are not significantly different, except for one page where it prompts us to use Packages or Parcels. Once the cluster is set …
Let us discuss details about installing Cloudera Manager Server and Agents. Cloudera Manager Server will be running on one of the hosts in the cluster, while Agents need to run on all the hosts in the cluster. Cloudera Manager Server and Agents together facilitate us to easily set up CDH on the cluster as well …
