Command to import table and divide the data into multiple splits based on specified column. sqoop import –connect jdbc:mysql://ms.itversity.com:3306/retail_db –username retail_user –password itversity –table order_items –warehouse-dir /user/training/sqoop_import/retail_db –delete-target-dir –split-by order_item_order_id
Command to explore first 10 records of orders table: sqoop eval –connect jdbc:mysql://ms.itversity.com:3306/retail_db –username retail_user –password itversity -e “SELECT * FROM orders LIMIT 10” Command to explore orders table with where condition; sqoop eval –connect jdbc:mysql://ms.itversity.com:3306/retail_db –username retail_user –password itversity -e “SELECT * FROM orders WHERE order_status IN (‘COMPLETE’, ‘CLOSED’) AND order_date LIKE ‘2013-08%’ ” …
Command to retrieve table within specified maximum and minimum boundary value of primary key. sqoop import –connect jdbc:mysql://ms.itversity.com:3306/retail_db –username retail_user –password itversity –table order_items –warehouse-dir /user/training/sqoop_import/retail_db –boundary-query “SELECT 1, 172198” –delete-target-dir
To get schema details on customers table: sqoop eval –connect jdbc:mysql://ms.itversity.com:3306/ retail_db –username retail_user –password itversity -e “DESCRIBE customers” Command to import table with specified columns: sqoop import –connect jdbc:mysql://ms.itversity.com:3306/retail_db –username retail_user –password itversity –table customers –columns customer_id,customer_fname,customer_lname,customer_street,customer_city,customer_state,customer_zipcode –warehouse-dir /user/training/sqoop_import/retail_db –delete-target-dir To validate imported table: hadoop fs -ls /user/training/sqoop_import/retail_db hadoop fs -ls /user/training/sqoop_import/retail_db/customers hadoop fs …
Command to get information related customized options for sqoop import command: sqoop help import
Command to import order_items table using compress sqoop import –connect jdbc:mysql://ms.itversity.com:3306/ retail_db –username retail_user –password itversity –table order_items –warehouse-dir /user/training/sqoop_import/retail_db –delete-target-dir –compress Command to import table as compressed file using a specific compression codec sqoop import –connect jdbc:mysql://ms.itversity.com:3306/retail_db –username retail_user –password itversity –table order_items –warehouse-dir /user/training/sqoop_import/retail_db –delete-target-dir –compress –compression-codec org.apache.hadoop.io.compress.SnappyCodec
