Properties and Properties files of big data tools-general guidelines

Properties and properties files are an important part of many big data tools and platforms. They allow users to configure various settings and parameters for the tool, such as the location of input and output files, the size of memory allocated to the tool, and the number of nodes in a cluster. Here are some general guidelines for working with properties and properties files in big data tools:

In Hadoop Distributed File System (HDFS), the properties files are usually located in the Hadoop configuration directory, which is typically found at $HADOOP_HOME/etc/hadoop/. Within this directory, there are several files that define the properties for HDFS, such as core-site.xml, hdfs-site.xml, and mapred-site.xml.

For example, to view all the properties defined in core-site.xml, you can use the following command:


$ cat $HADOOP_HOME/etc/hadoop/core-site.xml

Share this post