188.Sqoop Import – Dealing with Primary Key or Split By using Non Numeric Field

  • Command to change the default property during runtime to deal with non-numeric field
    • sqoop import -Dorg.apache.sqoop.splitter.allow_text_splitter=true --connect jdbc:mysql://ms.itversity.com:3306/nyse --username nyse_user --password itversity --table stock_eod --warehouse-dir /user/training/sqoop_import/nyse --delete-target-dir
  • Command to validate imported data
    • hadoop fs -ls /user/training/sqoop_import/nyse/stock_eod
    • hadoop fs -tail /user/training/sqoop_import/nyse/stock_eod/part-m-00003

Share this post