We need to follow the standard process while setting up any software. Downloading and Installing – already taken care as part of adding hosts to the cluster. Architecture and Configuration – we need to understand architecture and plan for the configuration. Architecture – Zookeeper have all master architecture. Other services (typically masters of those services) …
As part of this section, we will see how to setup Zookeeper using Cloudera distribution. We will also understand important concepts related to Zookeeper. So far we have installed Cloudera manager and setup CM Services in the cluster. Here we will be adding one component after another to understand the architecture. In the production environment, …
The following are several services as part of Cloudera Management Service: Service Monitor – To monitor services like Hadoop, hive etc. that are installed in the cluster Activity Monitor – To monitor the jobs run by different cluster services like Pig, Hive, Oozie, MapReduce etc. Activity Monitor is not included while setting up Management Service. …
Now let us setup Cloudera Management Service. We will ignore those that are not automatically selected and switch all the components to bigdataserver-1 Go to Cloudera Manager and Add Management Service Make sure all the services are running on bigdataserver-1 You need to configure the database for Reports Manager And then, Cloudera Management service is …
We started with Cloudera Manager Server and then we have installed CDH and CM components using Cloudera Manager web interface. You should have observed that Cloudera Manager agents are installed as part of installation of Cloudera Manager Components. Agents will be running on all the nodes in the cluster including one which have Cloudera Manager. …
Now let us install CM and CDH on all nodes using packages. It will take care of installing Cloudera Manager Agents along with CDH components such as Hadoop, Spark etc on all nodes in the cluster. Once installation is done, we will be configuring one service at a time as we get into the details …
