As emphasized earlier queries against Hive Databases can be run using different Query Engines. Map Reduce which is the default Tez which comes as part of Hortonworks distribution. Impala which comes as part of Cloudera distribution. Drill which comes as part of MapR distribution. Presto which is developed in Facebook Spark SQL which comes as …
Hive Commands and Queries are very important for developers. However, it is important for Big Data Administrators to have some knowledge about these. Hive CLI can be launched using hive. We can also run individual hive commands without getting into Hive CLI using hive -e. We can also use hive -s to pass series of …
Now let us look into how we can troubleshoot Hive issues. We have server components such as Hive Metastore and HiveServer2 running on bigdataserver-4. If we need to troubleshoot any issues related to those we need to login to bigdataserver-4 and go to /var/log/hive. There will be a different log file for each of the …
Hive uses HDFS for storage, different processing engines to process the data. As it works on HDFS and processing engines such as Map Reduce, Spark, YARN (Tez) etc we do not have any daemon processes running on worker nodes. Data storage – HDFS Processing Engine – Map Reduce or Tez or Spark SQL Metastore – …
As Hive and Impala are configured on the cluster, now let us validate by running some Hive as well as Impala queries. Both Hive as well as Impala, have CLI We can launch Hive CLI using hive command while we need to specify one of the servers on which Impala Daemon is running to launch impala-shell …
Once servers are created, we can connect to them on Google Cloud using gcloud and ssh using our terminal. Click here to get instructions to setup gcloud We will be using Debian/Ubuntu instructions (on Windows System). Follow the instructions on the page. No need to install additional packages. Make sure to run gcloud init Use …
