[
https://issues.apache.org/jira/browse/HIVE-23685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krisztian Kasa resolved HIVE-23685.
-----------------------------------
Resolution: Fixed
Pushed to master. Thank you [~Qiang.Kang]!
> Removing user's extra resources while executing File Merge Task
> ---------------------------------------------------------------
>
> Key: HIVE-23685
> URL: https://issues.apache.org/jira/browse/HIVE-23685
> Project: Hive
> Issue Type: Bug
> Components: Physical Optimizer, Query Planning
> Affects Versions: All Versions
> Reporter: Qiang.Kang
> Assignee: Qiang.Kang
> Priority: Critical
> Labels: pull-request-available
> Attachments: HIVE-23685.02.patch, HIVE-23685.1.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Hi, we find that MapReduce's file merge map containers will download user's
> extra resources(such as: added jars, files, archives) before launching task.
> When these resources are large or the network is busy, file merge jobs will
> be timeout, causing the query be failed. As we all know, file merge task will
> run correctly just with hive-exec.jar and MapReduce framework. Therefore,
> there is no need to download user's resources. The patch below prevents
> setting `tmpjars` for FileMerge Task.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
