Uncategorized

Command to connect to mysql mysql -u retail_user -h ms.itversity.com -p Command to connect to a database USE retail_export; Command to get meta-data on table DESCRIBE training_daily_revenue; Command to truncate the table TRUNCATE TABLE training_daily_revenue; Command to insert single record into table INSERT INTO training_daily_revenue VALUES (‘2013-07-25 00:00:00.0’,12500.0) ; INSERT INTO training_daily_revenue VALUES (‘2013-07-26 00:00:00.0’,15000.0) …

215.Sqoop Export – Quick Overview of MySQL for Upsert Read More »

Refer to sqoop user guide here. Refer to sqoop user-guide on export command here.

To troubleshoot the issue in sqoop export, Go to the link given in error message as shown in the image below and refer the logs to understand the error.

Command to Export data by specifying number of mappers sqoop export –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password itversity –export-dir /apps/hive/warehouse/training_sqoop_retail.db/daily_revenue –table training_daily_revenue –num-mappers 1

The “sqoop export” command is used to export data from Hadoop to a relational database. The execution flow of “sqoop export” can be described as follows: First, Sqoop establishes a connection to the source database and fetches the data that needs to be exported. The data can be filtered, transformed or sorted using various Sqoop …

211.Sqoop Export – Execution Flow Read More »

Command to get list of tables SHOW tables; Command to get meta-data on table DESCRIBE FORMATTED daily_revenue; Command to export table from hive to mysql sqoop export –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password itversity –export-dir /apps/hive/warehouse/training_sqoop_retail.db/daily_revenue –table training_daily_revenue Command to validate table sqoop eval –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password itversity -e “SELECT * FROM training_daily_revenue LIMIT …

210.Sqoop Export – Perform Simple Export – –table and –export-dir Read More »