[
https://issues.apache.org/jira/browse/SQOOP-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shuaishuai Nie updated SQOOP-1192:
----------------------------------
Assignee: Shuaishuai Nie
> Add option "--skip-dist-cache" to allow Sqoop not copying jars in
> %SQOOP_HOME%\lib folder when launched by Oozie and use Oozie share lib
> ----------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SQOOP-1192
> URL: https://issues.apache.org/jira/browse/SQOOP-1192
> Project: Sqoop
> Issue Type: Bug
> Reporter: Shuaishuai Nie
> Assignee: Shuaishuai Nie
> Attachments: SQOOP-1192.1.patch, SQOOP-1192.2.patch
>
>
> Now Sqoop will copy jar files in %SQOOP_HOME%\lib folder to the job cache
> every time a Sqoop job is launched. When Oozie launch a Sqoop job, this
> behavior can be optimized by add these jars in Oozie Sqoop sharelib. In this
> case, the jar files in share lib only needed be localized to each worker node
> once and reuse by all Sqoop job launched by Oozie. This can reduce massive
> disk I/O on worker node when using Sqoop by Oozie. To enable this, Sqoop need
> to have an option which enable the job to skip adding lib jars to the job
> cache. For now, this option should only be used by Oozie started Sqoop job.
> The patch attached introduce "--skip-dist-cache" option to enable this
> feature.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
