[
https://issues.apache.org/jira/browse/SQOOP-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13526894#comment-13526894
]
Dan Richelson edited comment on SQOOP-360 at 12/8/12 12:53 AM:
---------------------------------------------------------------
I too am having this problem with an import from Postgresql 8.4. I am
specifying 30 mappers and using a "split-by" operator. I'm using Sqoop 1.4.1
(CDH4.0.1). I have experienced this in our production environment pulling 10s
of thousands of rows at once.. sorry I can't share the actual data.
was (Author: drichelson):
I too am having this problem with an import from Postgresql 8.4. I am
specifying 30 mappers and using a "split-by" operator. I'm using Sqoop 1.4.1
(CDH4.0.1). I have experienced this in our production environment pulling 10s
of thousands of rows at once.. sorry I can't share the actial data.
> Duplication of the record in the case of using import mode
> -----------------------------------------------------------
>
> Key: SQOOP-360
> URL: https://issues.apache.org/jira/browse/SQOOP-360
> Project: Sqoop
> Issue Type: Bug
> Components: connectors
> Affects Versions: 1.3.0
> Reporter: SATOSHI KONDO
> Labels: patch
> Attachments: SQOOP-360.patch
>
>
> When I use Import mode of Sqoop,
> I get duplicate records.
> This occurs on condition of the following.
> 1.Use Import mode of Sqoop
> 2.Set a character type to "split-by" parameter
> 3.Set a big value to "num-mappers" parameter
> The big value is a relatively large thing as compared with the total number
> of records.
> For example,
> when total number of records is 10,
> I set 100 to "num-mappers" parameter.
> I expect to get 10 records.
> But I get 10 or more lines.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
