Let us see how we can configure a proxy for Hiveserver2 as well as Impala. To configure Proxy we need to have software called haproxy. We can have multiple servers for clients to connect. There are several advantages of High Availability and Proxy. Load Balancing Transparent Fail Over When we have multiple servers for client …
Do you want to know how to set up local yum repository server so that we can download binaries from with in the network of the enterprise rather than downloading from the internet? First we need to setup local yum repository server. Steps involved to setup local yum repo server Overview of yum Setup httpd …
Let us understand details about Configuring a Service using Cloudera Manager. We can add any supported service using Cloudera Manager. All the services exhibit default run-time behavior. If we need to change the run-time behavior of any service, we need to identify the appropriate property and update. If we could not identify any property, then …
Perform basic and advanced configuration needed to effectively administer a Hadoop cluster Configure a Service using Cloudera Manager Create an HDFS user’s home directory Configure NameNode HA Configure ResourceManager HA Configure proxy for Hiveserver2/Impala
We have added several services to our cluster using Cloudera Manager. Following are the services added as part of the demonstrations. Zookeeper Hadoop (HDFS and YARN with MR2) Spark and Spark 2 Hive and Impala Sqoop, Pig, Oozie and Hue HBase Kafka Here are the general guidelines to add any supported service. Understand Architecture – …
Let us see how we can add the new node as a worker to the cluster. Worker Components: HDFS Datanode YARN Node Manager HBase Region Server Impala Impalad To add a node as HDFS Datanode, we need to have additional storage devices mounted and formatted. https://gist.github.com/dgadiraju/55d5c81b319748502bfcfab78f3602d5 Once the node is formatted, either we can use …
