Chat with us, powered by LiveChat Big Data – Hadoop EcosystemsImport the accounts table into HDFS file system:1) Import account:$ sqoo | Economics Write
+1(978)310-4246 credencewriters@gmail.com
  

Big Data – Hadoop EcosystemsImport the accounts table into HDFS file system:1) Import account:$ sqoop import –connect jdbc:mysql://localhost/loudacre –username training –password training –table accounts –target-dir /loudacre/accounts –null-non-string ‘\N’2) List the contents of the accounts directory:$ hdfs dfs -ls /loudacre/accounts3) Import incremental updates to accountsAs Loudacre adds new accounts in MySQL accounts table, the account data in HDFS must be updated as accounts are created. You can use Sqoop to append these new records.Run the add_new_accounts.py script to add the latest accounts to MySQL.$ DEV1/exercises/sqoop/add_new_accounts.pyIncrementally import and append the newly added accounts to the accounts directory. Use Sqoop to import on the last value on the acct_num column largest account ID:$ sqoop import –connect jdbc:mysql://localhost/loudacre –username training –password training –incremental append –null-non-string ‘\N’ –table accounts –target-dir /loudacre/accounts –check-column acct_num –last-value 4) You should see three new files. Use Hadoop’s cat command to view the entire contents of these files.hdfs dfs -cat /loudacre/accounts/part-m-0000[456]
Big Data – Hadoop Ecosystems Import the accounts table into HDFS file system: 1) Import account: $ sqoop import –connect jdbc:mysql://localhost/loudacre –username training –password training
Big Data – Hadoop Ecosystems Import the accounts table into HDFS file system: Import account: $ sqoop import –connect jdbc:mysql://localhost/loudacre –username training –password training –table accounts –target-dir /loudacre/accounts –null-non-string ‘\N’ List the contents of the accounts directory: $ hdfs dfs -ls /loudacre/accounts Import incremental updates to accounts As Loudacre adds new accounts in MySQL accounts table, the account data in HDFS must be updated as accounts are created. You can use Sqoop to append these new records. Run the add_new_accounts.py script to add the latest accounts to MySQL. $ DEV1/exercises/sqoop/add_new_accounts.py Incrementally import and append the newly added accounts to the accounts directory. Use Sqoop to import on the last value on the acct_num column largest account ID: $ sqoop import –connect jdbc:mysql://localhost/loudacre –username training –password training –incremental append –null-non-string ‘\N’ –table accounts –target-dir /loudacre/accounts –check-column acct_num –last-value You should see three new files. Use Hadoop’s cat command to view the entire contents of these files. hdfs dfs -cat /loudacre/accounts/part-m-0000[456]

error: Content is protected !!