Hive properties are configuration settings that control the behavior of the Hive runtime. They can be set at various levels, including the system level, the Hive server level, and the session level. Here are two common ways to set Hive properties: SET command: You can set Hive properties at the session level using the SET …
Section 6:49. Overview of Hive Properties -Set and .hiverc Read More »
Hive CLI (Command Line Interface) is a tool that provides a command-line interface to interact with the Hive database. It allows users to run HiveQL queries and perform administrative tasks such as creating databases and tables, managing partitions, and executing scripts. Hive CLI is typically used by developers, analysts, and administrators who prefer a command-line …
The hdfs fsck command is a tool used in HDFS (Hadoop Distributed File System) to check the health of the file system and diagnose any issues. hdfs fsck can be used to check the consistency of file system metadata, such as block placement and replication, and to detect and correct any inconsistencies. Here’s an example …
Section 5:45.Getting metadata of Files using “hdfs fsck” Read More »
In HDFS (Hadoop Distributed File System), block size and replication factor are two important concepts that determine the storage and data availability of a file stored in HDFS. Block size: The block size in HDFS is the size of each block of a file that is stored in the HDFS cluster. By default, the block …
Section 5:44. Overview of Block size and Replication factor Read More »
The hadoop fs -df -h command in HDFS (Hadoop Distributed File System) is used to display the disk space used and disk space available in a human-readable format. The -df option is used to show disk usage statistics and the -h option is used to display the output in a human-readable format (i.e., using units …
Section 5:43. Understanding Size of the File System and Data Sets using df and du Read More »
We can also copy files within HDFS using commands like cp and mv. hadoop fs -cp to copy files from one HDFS location to another HDFS location hadoop fs -mv to move files from one HDFS location to another HDFS location mv is faster than cp as mv deals with only metadata whereas cp has …
Section 5:42. Copying or Moving Files from one HDFS location to other HDFS location Read More »
