[
https://issues.apache.org/jira/browse/MAPREDUCE-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12850552#action_12850552
]
Hudson commented on MAPREDUCE-1489:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #271 (See
[http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/271/])
. DataDrivenDBInputFormat should not query the database when generating
only one split. Contributed by Aaron Kimball.
> DataDrivenDBInputFormat should not query the database when generating only
> one split
> ------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1489
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1489
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/sqoop
> Reporter: Aaron Kimball
> Assignee: Aaron Kimball
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1489.patch
>
>
> DataDrivenDBInputFormat runs a query to establish bounding values for each
> split it generates; but if it's going to generate only one split
> (mapreduce.job.maps == 1), then there's no reason to do this. This will
> remove overhead associated with a single-threaded import of a non-indexed
> table since it avoids a full table scan.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
