[ 
https://issues.apache.org/jira/browse/HIVE-24866?focusedWorklogId=607551&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-607551
 ]

ASF GitHub Bot logged work on HIVE-24866:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 07/Jun/21 00:17
            Start Date: 07/Jun/21 00:17
    Worklog Time Spent: 10m 
      Work Description: github-actions[bot] commented on pull request #2057:
URL: https://github.com/apache/hive/pull/2057#issuecomment-855489135


   This pull request has been automatically marked as stale because it has not 
had recent activity. It will be closed if no further activity occurs.
   Feel free to reach out on the d...@hive.apache.org list if the patch is in 
need of reviews.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 607551)
    Time Spent: 40m  (was: 0.5h)

> FileNotFoundException during alter table concat
> -----------------------------------------------
>
>                 Key: HIVE-24866
>                 URL: https://issues.apache.org/jira/browse/HIVE-24866
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 2.4.0, 3.2.0, 4.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> Because of the way combinefile IF groups files based on node and rack 
> locality, there are cases where single big orc file gets spread across 2 or 
> more combine hive split. When first task completes, as part of jobCloseOp the 
> source orc file of concatenation is moved/renamed which can lead to 
> FileNotFoundException in subsequent mappers that has partial split of that 
> file. 
> A simple fix would be for the mapper with start of the split to own the 
> entire orc file for concatenation. If a mapper gets partial split which is 
> not the start then it can skip the entire file. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to