Let us review some of the important properties associated with Zookeeper. Use Cloudera Manager and go to configs Also go to /etc/zookeeper/conf to review the properties dataDir dataLogDir – for snapshots of transaction logs. tickTime – used for heartbeat clientPort server.* Cloudera Manager manages run time properties in unique way. When ever you restart a …
This is the first CDH service that we are going to configure on the cluster. It is open source application which manages distributed applications in simple and reliable manner. Once setup is completed one of the servers will be elected as the leader and all other servers are followers. Followers receive message proposals from the …
We need to follow the standard process while setting up any software. Downloading and Installing – already taken care as part of adding hosts to the cluster. Architecture and Configuration – we need to understand architecture and plan for the configuration. Architecture – Zookeeper have all master architecture. Other services (typically masters of those services) …
As part of this section, we will see how to setup Zookeeper using Cloudera distribution. We will also understand important concepts related to Zookeeper. So far we have installed Cloudera manager and setup CM Services in the cluster. Here we will be adding one component after another to understand the architecture. In the production environment, …
The following are several services as part of Cloudera Management Service: Service Monitor – To monitor services like Hadoop, hive etc. that are installed in the cluster Activity Monitor – To monitor the jobs run by different cluster services like Pig, Hive, Oozie, MapReduce etc. Activity Monitor is not included while setting up Management Service. …
Now let us setup Cloudera Management Service. We will ignore those that are not automatically selected and switch all the components to bigdataserver-1 Go to Cloudera Manager and Add Management Service Make sure all the services are running on bigdataserver-1 You need to configure the database for Reports Manager And then, Cloudera Management service is …
