Section 5:40.Getting Files and Directories From HDFS

To copy files from HDFS to the local file system, you can use the hdfs dfs -get command. The basic syntax for the command is:

hdfs dfs -get <hdfs_src> <local_dst>

where <hdfs_src> is the path to the file or directory in HDFS that you want to copy, and <local_dst> is the path to the destination directory on the local file system.

For example, to copy a single file /data/example.txt from HDFS to the local file system, you can use the following command:

hdfs dfs -get /data/example.txt .

The  `.` at the end of the command specifies the current directory on the local file system as the destination for the file.

Here is the command used to getting files from HDFS to local directory cards

If the HDFS file is too big to be viewed in its entirety, you can use the “head” and “tail” commands to view the beginning and end of the file, respectively. Here’s how to do it:

  1. Use the “head” command to view the beginning of the file:
  2. Use the “tail” command to view the end of the file:

Share this post