Durga Gadiraju

Refer to sqoop user guide here. Refer to sqoop user-guide on export command here.

To troubleshoot the issue in sqoop export, Go to the link given in error message as shown in the image below and refer the logs to understand the error.

Command to Export data by specifying number of mappers sqoop export –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password itversity –export-dir /apps/hive/warehouse/training_sqoop_retail.db/daily_revenue –table training_daily_revenue –num-mappers 1

The “sqoop export” command is used to export data from Hadoop to a relational database. The execution flow of “sqoop export” can be described as follows: First, Sqoop establishes a connection to the source database and fetches the data that needs to be exported. The data can be filtered, transformed or sorted using various Sqoop …

211.Sqoop Export – Execution Flow Read More »

Command to get list of tables SHOW tables; Command to get meta-data on table DESCRIBE FORMATTED daily_revenue; Command to export table from hive to mysql sqoop export –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password itversity –export-dir /apps/hive/warehouse/training_sqoop_retail.db/daily_revenue –table training_daily_revenue Command to validate table sqoop eval –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password itversity -e “SELECT * FROM training_daily_revenue LIMIT …

210.Sqoop Export – Perform Simple Export – –table and –export-dir Read More »

Command to get list of tables SHOW tables; Command to get meta-data on table DESCRIBE daily_revenue; Command to connect to my sql mysql -u retail_user -h ms.itversity.com -p Command to get list of databases show databases; Command to connect to a database USE retail_export; Command to create table CREATE TABLE training_daily_revenue (order_date VARCHAR(25) PRIMARY KEY,revenue …

209.Creating Table in MySQL Read More »