Command to import order_items table using –warehouse-dir: sqoop import –connect jdbc:mysql://ms.itversity.com:3306/retail_db –username retail_user –password itversity –table order_items –warehouse-dir /user/training/sqoop_import/retail_db To validate the imported table: hadoop fs -Is /user/training/sqoop_import/retail_db/order_items
Command to check if the directory path exists: hadoop fs -ls /user/training/sqoop_import Command to create the directory if it doesn’t exist: hadoop fs -mkdir /user/training/sqoop_import Command to import orders table: sqoop import –connect jdbc:mysql://ms.itversity.com:3306/retail_db –username retail_user –password itversity –table orders –target-dir /user/training/sqoop_import/retail_db/orders To validate the imported table: hadoop fs -Is /user/training/sqoop_import/retail_db/orders
To get information on commands available with respect to import command sqoop help import Refer to sqoop user-guide on import command here.
To redirect log messages to other files sqoop eval –connect jdbc:mysql://ms.itversity.com:3306/retail_db –username retail_user –password itversity –query “SELECT * FROM orders LIMIT 10” l>query.out 2>query.err In above command, 1 refers to standard output, Where output will be redirected and saved to file query.out. 2 refers to standard error, Where error message will be redirected and saved …
Logs will be generated in the CLI as we run a query in the CLI, As shown in the image.
To get information on commands available with respect to eval command sqoop help eval Command to evaluate SQL statements against a database and return the results sqoop eval –connect jdbc:mysql://hostname:port/database_name –username your_username -P –query “SELECT * FROM table_name LIMIT 10;” Example: sqoop eval –connect jdbc:mysql://ms.itversity.com/retail_db –username retail_user –password itversity –query “SELECT * FROM orders LIMIT …
