We started with Cloudera Manager Server and then we have installed CDH and CM components using Cloudera Manager web interface. You should have observed that Cloudera Manager agents are installed as part of installation of Cloudera Manager Components. Agents will be running on all the nodes in the cluster including one which have Cloudera Manager. …
Now let us install CM and CDH on all nodes using packages. It will take care of installing Cloudera Manager Agents along with CDH components such as Hadoop, Spark etc on all nodes in the cluster. Once installation is done, we will be configuring one service at a time as we get into the details …
Let us understand different licensing options as well as installation options. Different licensing option – Express vs. Enterprise license We are not going to cover Enterprise licensing in detail. It is typically done between management of your enterprise and Cloudera sales team. Installation using Parcels Recommended by Cloudera We can create local repositories for parcels …
Cloudera Manager is the management tool for setup and manage clusters. It provides wizard to setup cluster as well as to configure alerts in case of any issues. Install Cloudera Manager – sudo yum -y install cloudera-manager-server Stop Cloudera Manager – sudo systemctl stop cloudera-scm-server Setup scm database – sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql -h localhost scm root …
In this topic, we will set up data sets on our local machine for basic I/O operations By using git we clone the data sets into our local machine use this command in the terminal for setting up data sets git clone https://github.com/dgadiraju/data.git In labs, the data sets are pre-exist
Let us setup pre-requisites like JDK and MySQL database so that we can configure cloudera manager and other CDH components using external database. Install Java SDK that come with Cloudera – sudo yum install oracle-j2sdk1.7 -y Install mysql (mariadb) https://gist.github.com/dgadiraju/c35eb63a77438b5bacacdd43ca14ba74 Setup mysql connector – sudo yum -y install mysql-connector-java We need to install mysql-connector-java on other nodes …
