But when I do the same with '--incremental append' it is working fine except that I see duplicates which is as expected.
On Tuesday, March 1, 2016, Deepak Vohra <[email protected]> wrote: > '--incremental lastmodified cannot be used in conjunction with > --as-avrodatafile' > Being binary data avro data may not be incrementable. > -------------------------------------------- > On Tue, 3/1/16, Ajay Chander <[email protected] <javascript:;>> wrote: > > Subject: Question_about_Sqoop_Avro > To: "[email protected] <javascript:;>" <[email protected] > <javascript:;>> > Date: Tuesday, March 1, 2016, 12:01 PM > > Hi Everyone, > I just have a question about using sqoop > incremental operation with --as-avrodatafile. > Let's say initially I did a sqoop import to > pull the table 'xyz' from mysql db to HDFS with > option '--as-avrodatafile'. Now let us say that I have some new data > added to source system(xyz table in MySQL) now I want to > run a sqoop incremental job to get those changes updated in > HDFS with option '--as-avrodatafile'. When I try to do that it > says '--incremental lastmodified cannot be used in > conjunction with > --as-avrodatafile' > Any > pointers are appreciated. Thanks. >
