the transporter 4 mysql
DESCRIPTION
import & exports for MySQL to HDFS (Hadoop), HBase, Hive, csv, sql, tsv, text, xml, installing Apache Sqoop,problems associated with import & exportTRANSCRIPT
The Transporter4
MySQL
A visual Guide 4 Importing & Exporting
csv, xml, tsv, text, sql, MySql, HDFS, Hive, HBase
contents
• Export 2 csv
• Import csv
• Exporting 2 sql
• Importing sql
• Exporting 2 xml
• Importing xml
• Exporting 2 tsv
• Exporting 2 text
• Exporting 2 HDFS
• Installing Apache Sqoop
• exporting 2 HDFS
• Importing 2 MySQL
• Exporting 2 Hive
• Exporting 2 HBase
open MySQL
exporting to CSV
exporting CSV – Problem ?
check Appamor status
AA Status
AA
go to apparmor.d
edit usr.sbin.mysqld
usr.sbin.mysqld
after editing usr.sbin.mysqld
make /tmp/data directory
make /data directory
mounting
reload apparmor
restarting apparmor . . .
exporting .csv
Importing csv
importing .csv – problem ?
importing .csv
edit my.cnf
my.cnf file
after editing my.cnf
importing .csv
exporting sql
view tables
create country table
inserting data into country table
exporting .sql
exported .sql file
Importing sql
importing .sql
exporting xml
exporting .xml
importing xml
importing xml
exporting tsv
exporting .tsv
exported .tsv file
exporting txt
exporting .txt
exported .txt file
exporting to HDFS
installing Apache Sqoop
Apache Sqoop Home Page
Sqoop folder structure
add mysqlJ connector in SqoopHome/lib
export & check version
sqoop help
list databases
make dir in HDFS
check mysql tables
grant permissions
exporting 2 HDFS
exporting completes
Intermediate .java file (mapReduce)
HDFS table
exporting to HDFS
exporting to HDFS
importing to MySQL (4m HDFS)
HDFS table
make MySQL table structure
importing to MySQL
importing completes
imported table
exporting to Hive
check Hive for redundant table
exporting 2 Hive
libthrift version error
export fake HBase_Home
check Hive tables
export to HBase
mysql table
employee table
start HBase daemons
exporting to HBase
exporting completes
all Sqoop queries
finish