Let us see how we can override properties while running commands such as hadoop fs. Let us first review properties files such as core-site.xml and hdfs-site.xml. We can override any non-final property using -Dproperty_name=property_value as part of hadoop fs command. We can also use options such as -fs to override Namenode URI We can also change replication …
https://gist.github.com/dgadiraju/fed51f71eb1eb9a086eaefc03b3cd577
ACLs stands for Access Control Lists and it gives finer level access control over files. Without ACLs permissions are controlled at owner, group and others levels only. To use ACLs in HDFS, we need to set dfs.namenode.acls.enabled to true as part of hdfs-site.xml. We can use hadoop fs -setfacl to set ACL at file or directory …
ACLs stands for Access Control Lists and it gives finer level access control over files. Without ACLs permissions are controlled at owner, group and others levels only. To use ACLs in HDFS, we need to set dfs.namenode.acls.enabled to true as part of hdfs-site.xml. We can use hadoop fs -setfacl to set ACL at file or directory …
Controlling Access using ACLs – Enable ACLs on Cluster Read More »
Let us go through file permissions in HDFS. As we create the files, we can check the permissions on them using -ls command. Typically the owner of the user space will have rwx, while members of the group specified as well as others have rx We can change the permissions using hadoop fs -chmod We can …
Managing files and file permissions – HDFS File permissions Read More »
Let us see how we can preview the data in HDFS. If we are dealing with files contain text data (files of text file format), we can preview contents of the files using different commands as -tail, -cat etc. -tail can be used to preview last 1 KB of the file -cat can be used …
Managing files and file permissions – previewing data in HDFS Read More »
