[jira] [Updated] (HIVE-21698) TezSessionState#ensureLocalResources() causes IndexOutOfBoundsException while localizing resources
[ https://issues.apache.org/jira/browse/HIVE-21698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-21698: Fix Version/s: 4.0.0 Resolution: Fixed Status: Resolved (was: Patch Available) Committed to master. Thanks [~nareshpr] and [~ShubhamChaurasia] for the contribution! > TezSessionState#ensureLocalResources() causes IndexOutOfBoundsException while > localizing resources > -- > > Key: HIVE-21698 > URL: https://issues.apache.org/jira/browse/HIVE-21698 > Project: Hive > Issue Type: Bug > Components: Query Processor, Tez >Affects Versions: 3.1.1 >Reporter: Shubham Chaurasia >Assignee: Naresh P R >Priority: Major > Fix For: 4.0.0 > > Attachments: HIVE-21698.1.patch, HIVE-21698.2.patch, HIVE-21698.patch > > > The cause of exception is due to [this loops > over|https://github.com/apache/hive/blob/rel/release-3.1.1/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java#L633] > {{newFilesNotFromConf}} and tries to access {{newResources.get(i)}} in that. > Size of {{newResources}} is determined by [utils.localizeTempFiles() > here|https://github.com/apache/hive/blob/rel/release-3.1.1/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java#L629] > which may return a smaller list depending upon the {{skipFilesFromConf}} and > this would result in {{newResources.size()}} < {{newFilesNotFromConf.length}} > causing IndexOutOfBounds. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-21698) TezSessionState#ensureLocalResources() causes IndexOutOfBoundsException while localizing resources
[ https://issues.apache.org/jira/browse/HIVE-21698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-21698: -- Attachment: HIVE-21698.2.patch > TezSessionState#ensureLocalResources() causes IndexOutOfBoundsException while > localizing resources > -- > > Key: HIVE-21698 > URL: https://issues.apache.org/jira/browse/HIVE-21698 > Project: Hive > Issue Type: Bug > Components: Query Processor, Tez >Affects Versions: 3.1.1 >Reporter: Shubham Chaurasia >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-21698.1.patch, HIVE-21698.2.patch, HIVE-21698.patch > > > The cause of exception is due to [this loops > over|https://github.com/apache/hive/blob/rel/release-3.1.1/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java#L633] > {{newFilesNotFromConf}} and tries to access {{newResources.get(i)}} in that. > Size of {{newResources}} is determined by [utils.localizeTempFiles() > here|https://github.com/apache/hive/blob/rel/release-3.1.1/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java#L629] > which may return a smaller list depending upon the {{skipFilesFromConf}} and > this would result in {{newResources.size()}} < {{newFilesNotFromConf.length}} > causing IndexOutOfBounds. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-21698) TezSessionState#ensureLocalResources() causes IndexOutOfBoundsException while localizing resources
[ https://issues.apache.org/jira/browse/HIVE-21698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-21698: -- Attachment: HIVE-21698.1.patch > TezSessionState#ensureLocalResources() causes IndexOutOfBoundsException while > localizing resources > -- > > Key: HIVE-21698 > URL: https://issues.apache.org/jira/browse/HIVE-21698 > Project: Hive > Issue Type: Bug > Components: Query Processor, Tez >Affects Versions: 3.1.1 >Reporter: Shubham Chaurasia >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-21698.1.patch, HIVE-21698.patch > > > The cause of exception is due to [this loops > over|https://github.com/apache/hive/blob/rel/release-3.1.1/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java#L633] > {{newFilesNotFromConf}} and tries to access {{newResources.get(i)}} in that. > Size of {{newResources}} is determined by [utils.localizeTempFiles() > here|https://github.com/apache/hive/blob/rel/release-3.1.1/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java#L629] > which may return a smaller list depending upon the {{skipFilesFromConf}} and > this would result in {{newResources.size()}} < {{newFilesNotFromConf.length}} > causing IndexOutOfBounds. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Updated] (HIVE-21698) TezSessionState#ensureLocalResources() causes IndexOutOfBoundsException while localizing resources
[ https://issues.apache.org/jira/browse/HIVE-21698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naresh P R updated HIVE-21698: -- Attachment: HIVE-21698.patch Status: Patch Available (was: In Progress) > TezSessionState#ensureLocalResources() causes IndexOutOfBoundsException while > localizing resources > -- > > Key: HIVE-21698 > URL: https://issues.apache.org/jira/browse/HIVE-21698 > Project: Hive > Issue Type: Bug > Components: Query Processor, Tez >Affects Versions: 3.1.1 >Reporter: Shubham Chaurasia >Assignee: Naresh P R >Priority: Major > Attachments: HIVE-21698.patch > > > The cause of exception is due to [this loops > over|https://github.com/apache/hive/blob/rel/release-3.1.1/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java#L633] > {{newFilesNotFromConf}} and tries to access {{newResources.get(i)}} in that. > Size of {{newResources}} is determined by [utils.localizeTempFiles() > here|https://github.com/apache/hive/blob/rel/release-3.1.1/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java#L629] > which may return a smaller list depending upon the {{skipFilesFromConf}} and > this would result in {{newResources.size()}} < {{newFilesNotFromConf.length}} > causing IndexOutOfBounds. -- This message was sent by Atlassian Jira (v8.3.2#803003)