[
https://issues.apache.org/jira/browse/SQOOP-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15969653#comment-15969653
]
viru reddy edited comment on SQOOP-3158 at 4/14/17 10:57 PM:
-------------------------------------------------------------
I found a work around for this scenario.
After doing Incremental import as files, if we want to export the data back to
MySQL then do the following.
1) create a table test in hive using columns id , name and salary. Then load
the data into the table from the directory where we have both the initial and
incremental data files.
Now when we query the table test
You will have
1, raj,null
2,jack,null
3, jill,2000
4,Nick,3000
2) Then after this create a table mysql_export as select * from test
Then you can export the data by providing mysql_export table location as target
directory.
This worked for me, but It would be better if we have don't have to create two
tables for this kind of a scenarion
was (Author: viru2006):
I found a work around for this scenario.
After doing Incremental import as files, if we want to export the data back to
MySQL then do the following.
1) create a table test in hive using columns id , name and salary. Then load
the data into the table from the directory where we have both the initial and
incremental data files.
Now when we query the table test
You will have
1, raj,null
2,jack,null
3, jill,2000
4,Nick,3000
2) Then after this create a table mysql_export as select * from test
then you can export the data by providing mysql_export table location as target
directory.
This worked for me, but It would be better if we have don't have to create two
tables for this kind of a scenarion
> Columns added to Mysql after initial sqoop import, export back to table with
> same schema fails
> -----------------------------------------------------------------------------------------------
>
> Key: SQOOP-3158
> URL: https://issues.apache.org/jira/browse/SQOOP-3158
> Project: Sqoop
> Issue Type: Improvement
> Reporter: viru reddy
> Assignee: Eric Lin
> Labels: newbie
>
> I have table in MySQL with 2 columns until yesterday. The columns are id and
> name.
> 1,Raj
> 2,Jack
> I have imported this data into HDFS yesterday itself as a file. Today we
> added a new column to the table in MySQL called salary. The table looks like
> below.
> 1,Raj
> 2,Jack
> 3,Jill,2000
> 4,Nick,3000
> Now I have done Incremental import on this table as a file.
> Part-m-00000 file contains
> 1,Raj
> 2,Jack
> Part-m-00001 file contains
> 3,Jill,2000
> 4,Nick,3000
> Now I created a new table in MySQL with same schema as Original MySQL table
> with columns id name and salary.
> When I do sqoop export only last 2 rows are getting inserted to the new table
> in MySQL and the sqoop export fails
> How can I reflect all the rows to be inserted to the table.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
