Hive Commands and Queries are very important for developers. However, it is important for Big Data Administrators to have some knowledge about these. Hive CLI can be launched using hive. We can also run individual hive commands without getting into Hive CLI using hive -e. We can also use hive -s to pass series of …
Now let us look into how we can troubleshoot Hive issues. We have server components such as Hive Metastore and HiveServer2 running on bigdataserver-4. If we need to troubleshoot any issues related to those we need to login to bigdataserver-4 and go to /var/log/hive. There will be a different log file for each of the …
Hive uses HDFS for storage, different processing engines to process the data. As it works on HDFS and processing engines such as Map Reduce, Spark, YARN (Tez) etc we do not have any daemon processes running on worker nodes. Data storage – HDFS Processing Engine – Map Reduce or Tez or Spark SQL Metastore – …
As Hive and Impala are configured on the cluster, now let us validate by running some Hive as well as Impala queries. Both Hive as well as Impala, have CLI We can launch Hive CLI using hive command while we need to specify one of the servers on which Impala Daemon is running to launch impala-shell …
Once servers are created, we can connect to them on Google Cloud using gcloud and ssh using our terminal. Click here to get instructions to setup gcloud We will be using Debian/Ubuntu instructions (on Windows System). Follow the instructions on the page. No need to install additional packages. Make sure to run gcloud init Use …
Let us see how to setup Hive on an existing cluster using Cloudera Manager. Configure Hive Go to Add Service and select Hive Assign role or select the host to install the components – Gateway, HiveServer2 and Hive Metastore Server. We will be configuring Gateway on all nodes and Hive Server as well as Hive …
