Day: March 16, 2023

To troubleshoot the issue in sqoop export, Go to the link given in error message as shown in the image below and refer the logs to understand the error.

Command to Export data by specifying number of mappers sqoop export –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password itversity –export-dir /apps/hive/warehouse/training_sqoop_retail.db/daily_revenue –table training_daily_revenue –num-mappers 1

The “sqoop export” command is used to export data from Hadoop to a relational database. The execution flow of “sqoop export” can be described as follows: First, Sqoop establishes a connection to the source database and fetches the data that needs to be exported. The data can be filtered, transformed or sorted using various Sqoop …

211.Sqoop Export – Execution Flow Read More »

Command to get list of tables SHOW tables; Command to get meta-data on table DESCRIBE FORMATTED daily_revenue; Command to export table from hive to mysql sqoop export –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password itversity –export-dir /apps/hive/warehouse/training_sqoop_retail.db/daily_revenue –table training_daily_revenue Command to validate table sqoop eval –connect jdbc:mysql://ms.itversity.com:3306/retail_export –username retail_user –password itversity -e “SELECT * FROM training_daily_revenue LIMIT …

210.Sqoop Export – Perform Simple Export – –table and –export-dir Read More »

Command to get list of tables SHOW tables; Command to get meta-data on table DESCRIBE daily_revenue; Command to connect to my sql mysql -u retail_user -h ms.itversity.com -p Command to get list of databases show databases; Command to connect to a database USE retail_export; Command to create table CREATE TABLE training_daily_revenue (order_date VARCHAR(25) PRIMARY KEY,revenue …

209.Creating Table in MySQL Read More »

Command to launch hive connecting to the specified database hive –database training_sqoop_retail Command to get the list of tables in database SHOW tables; Command to get meta-data on tables DESCRIBE orders; DESCRIBE order_items; Command to preview the data in tables SELECT * FROM orders LIMIT 10; SELECT * FROM order_items LIMIT 10; Command to count …

208.Prepare data for Export Read More »