As part of this topic, we will explore another way of compiling and running the jar file with arguments through SBT We can make the changes to the code Recompile the jar file Run the jar file How to pass the arguments to the program Example import scala.io.Source object OrderRevenue { def main(args: Array[String]) = …
Development Cycle – Compile changes and run jar with arguments Read More »
As part of this topic, we will see how to setup SBT on Windows Machine Go to the link SBT Download click on the .msi of 0.13 version in the page Once the download is done click on the file and follows the procedure to install it Once the installation is done launch the command prompt …
Now let us have a look at how to create directories and manage ownership. By default hdfs is superuser of HDFS hadoop fs -mkdir – to create directories hadoop fs -chown – to change ownership of files chown can also be used to change the group. We can change the group using -chgrp command as …
Let us explore details about how to list the commands and get the help or usage for given command. Even though we can run commands from almost all the nodes in the clusters, we should only use Gateway to run HDFS Commands. First we need to make sure designated Gateway server is Gateway for HDFS …
As part of this topic, we will build the jar file and run as the jar file For building the jar file we typically use a tool called SBT SBT stands for a simple build tool Scala applications can be compiled in many other ways but SBT is the most popular one Set up SBT Go …
Development Cycle – Compile source code to jar using SBT Read More »
As part of this section we will get into all important HDFS commands. Getting list of commands and help Creating directories and changing ownership Managing files and file permissions Controlling access using ACLs Overriding Properties HDFS usage and Metadata Commands Creating Snapshots Using CLI for administration We are deliberately not sharing command snippets here for …
