Daniel Voros created SQOOP-3336:
-----------------------------------
Summary: Splitting on integer column can create more splits than
necessary
Key: SQOOP-3336
URL: https://issues.apache.org/jira/browse/SQOOP-3336
Project: Sqoop
Issue Type: Bug
Affects Versions: 1.4.7
Reporter: Daniel Voros
Assignee: Daniel Voros
Fix For: 1.5.0, 3.0.0
Running an import with {{-m 2}} will result in three splits if there are only
three consecutive integers in the table ({{\{1, 2, 3\}}}).
Work is (probably) spread more evenly between mappers this way, but ending up
with more files than expected could be an issue.
Split-limit can also result in more values than asked for in the last chunk
(due to the closed interval in the end).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)