Let us see the details about how to install and configure sentry. Sentry service is an RPC server that stores authorization metadata in an underlying relational database. It provides RPC interfaces to retrieve and manipulate privileges. We can integrate with Kerberos for Security. The service serves authorization metadata from the database backed storage; it does …
Let us create local repository for CDH5, it contain packages related to HDFS, YARN, Spark etc. Download cloudera-cdh5.repo Run reposync to copy RPMs locally Make sure RPMs are in the location that is being served by baseurl in repo file Go to the baseurl and run createrepo so that repodata directory is created Go to …
ACLs stands for Access Control Lists. It is primarily to provide finer level access to HDFS. Concept is inherited from Linux. We need to understand how to Configure HDFS ACLs using Cloudera Manager.
Enable relevant services and configure the cluster to meet goals defined by security policy; demonstrate knowledge of basic security practices Configure HDFS ACLs Install and configure Sentry Configure Hue user authorization and authentication Enable/configure log and query redaction Create Encrypted Zones in HDFS
Let us see the details with respect to commissioning or decommissioning a node. Decommissioning is nothing but stopping roles on the cluster. As discussed earlier, we have 3 types of Nodes. Behavior is a bit different for each type of Node. Gateway Master Maintenance – Decommission -> Complete Maintenance -> Recommission. Removing the hosts – …
Revise YARN resource assignment based on user feedback. The processing capacity of the cluster is determined by the capacity given to YARN. In our case, both Map Reduce as well as Spark is running using YARN. Node Manager Capacity Container Capacity Map Reduce – Map Task and Reduce Task Capacity Spark – Executores Capacity As …
