NameNode: NameNode works as a Master in a Hadoop cluster that guides the Datanode(Slaves). Namenode is mainly used for storing the Metadata i.e. the data about the data. Meta Data can be the transaction logs that keep track of the user’s activity in a Hadoop cluster. Meta Data can also be the name of the …
Section 4 :21.Hadoop distributed file system quick overview Read More »
Properties and properties files are an important part of many big data tools and platforms. They allow users to configure various settings and parameters for the tool, such as the location of input and output files, the size of memory allocated to the tool, and the number of nodes in a cluster. Here are some …
Properties and Properties files of big data tools-general guidelines Read More »
Refer to sqoop documentation here. Refer to sqoop user guide here.
To display information and usage instructions related to export command sqoop help export Command to connect to mysql mysql -u retail_user -h ms.itversity.com -p Command to connect to a database USE retail_export; Select statement on table SELECT count(1) FROM training_daily_revenue; Command to view records in table SELECT * FROM training_daily_revenue LIMIT 10; Command to delete …
To display information and usage instructions related to export command sqoop help export Command to launch hive connecting to the specified database hive –database training_sqoop_retail; Command to get list of tables SHOW tables; Command to create table CREATE TABLE daily_revenue01 AS SELECT * FROM daily_revenue; Command to get meta-data on table DESCRIBE FORMATTED daily_revenue01; Command …
Command to connect to mysql mysql -u retail_user -h ms.itversity.com -p Command to connect to a database USE retail_export; Command to get meta-data on table DESCRIBE training_daily_revenue; Command to truncate the table TRUNCATE TABLE training_daily_revenue; Command to alter table ALTER TABLE ADD description VARCHAR(200); Command to export data sqoop export –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password …
