[jira] [Updated] (HIVE-17754) InputJobInfo in Pig UDFContext is heavyweight, and causes OOMs in Tez AMs

2017-10-09 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17754: Status: Patch Available (was: Open) > InputJobInfo in Pig UDFContext is heavyweight

[jira] [Updated] (HIVE-17754) InputJobInfo in Pig UDFContext is heavyweight, and causes OOMs in Tez AMs

2017-10-09 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17754: Attachment: HIVE-17754.1.patch This fix depends on HIVE-11548. The attached patch co

[jira] [Comment Edited] (HIVE-17754) InputJobInfo in Pig UDFContext is heavyweight, and causes OOMs in Tez AMs

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16198244#comment-16198244 ] Mithun Radhakrishnan edited comment on HIVE-17754 at 10/10/17 4:59 PM: -

[jira] [Updated] (HIVE-11548) HCatLoader should support predicate pushdown.

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-11548: Attachment: HIVE-11548.7.patch > HCatLoader should support predicate pushdown. > ---

[jira] [Updated] (HIVE-11548) HCatLoader should support predicate pushdown.

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-11548: Attachment: HIVE-11548.7-branch-2.patch > HCatLoader should support predicate pushdo

[jira] [Updated] (HIVE-11548) HCatLoader should support predicate pushdown.

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-11548: Attachment: HIVE-11548.7-branch-2.2.patch > HCatLoader should support predicate push

[jira] [Updated] (HIVE-17754) InputJobInfo in Pig UDFContext is heavyweight, and causes OOMs in Tez AMs

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17754: Attachment: HIVE-17754.2.patch Addressing {{Test*HCatLoader}} test failures. > Inpu

[jira] [Assigned] (HIVE-17763) HCatLoader should fetch delegation tokens for partitions on remote HDFS

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17763: --- > HCatLoader should fetch delegation tokens for partitions on remote HDFS > -

[jira] [Updated] (HIVE-17763) HCatLoader should fetch delegation tokens for partitions on remote HDFS

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17763: Description: The Hive metastore might store partition-info for data stored on a remo

[jira] [Updated] (HIVE-17754) InputJobInfo in Pig UDFContext is heavyweight, and causes OOMs in Tez AMs

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17754: Attachment: HIVE-17754.2-branch-2.patch > InputJobInfo in Pig UDFContext is heavywei

[jira] [Updated] (HIVE-17763) HCatLoader should fetch delegation tokens for partitions on remote HDFS

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17763: Attachment: HIVE-17763.1.patch This fix depends on HIVE-11548 and HIVE-17754. This p

[jira] [Updated] (HIVE-17763) HCatLoader should fetch delegation tokens for partitions on remote HDFS

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17763: Status: Patch Available (was: Open) > HCatLoader should fetch delegation tokens for

[jira] [Updated] (HIVE-17754) HCat InputJobInfo in Pig UDFContext is heavyweight, and causes OOMs in Tez AMs

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17754: Summary: HCat InputJobInfo in Pig UDFContext is heavyweight, and causes OOMs in Tez

[jira] [Assigned] (HIVE-17770) HCatalog documentation for Pig type-mapping incorrect for "bag" types

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17770: --- > HCatalog documentation for Pig type-mapping incorrect for "bag" types > ---

[jira] [Resolved] (HIVE-17770) HCatalog documentation for Pig type-mapping incorrect for "bag" types

2017-10-10 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan resolved HIVE-17770. - Resolution: Fixed Corrected the cwiki-documentation, and left a note in the change

[jira] [Commented] (HIVE-17669) Cache to optimize SearchArgument deserialization

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16201143#comment-16201143 ] Mithun Radhakrishnan commented on HIVE-17669: - Thanks for the review, [~prasan

[jira] [Commented] (HIVE-17669) Cache to optimize SearchArgument deserialization

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16201155#comment-16201155 ] Mithun Radhakrishnan commented on HIVE-17669: - Updated documentation, [here|h

[jira] [Assigned] (HIVE-17781) Map MR settings to Tez settings via DeprecatedKeys

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17781: --- > Map MR settings to Tez settings via DeprecatedKeys > --

[jira] [Commented] (HIVE-17669) Cache to optimize SearchArgument deserialization

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16201253#comment-16201253 ] Mithun Radhakrishnan commented on HIVE-17669: - Thanks for pointing this out, [

[jira] [Updated] (HIVE-17781) Map MR settings to Tez settings via DeprecatedKeys

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17781: Attachment: HIVE-17781.1.patch Submitting for tests. > Map MR settings to Tez setti

[jira] [Updated] (HIVE-17781) Map MR settings to Tez settings via DeprecatedKeys

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17781: Status: Patch Available (was: Open) > Map MR settings to Tez settings via Deprecate

[jira] [Assigned] (HIVE-17784) Make Tez AM's Queue headroom calculation and nParallel tasks configurable.

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17784: --- > Make Tez AM's Queue headroom calculation and nParallel tasks configurable. > --

[jira] [Updated] (HIVE-17784) Make Tez AM's Queue headroom calculation and nParallel tasks configurable.

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17784: Status: Patch Available (was: Open) > Make Tez AM's Queue headroom calculation and

[jira] [Updated] (HIVE-17784) Make Tez AM's Queue headroom calculation and nParallel tasks configurable.

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17784: Attachment: HIVE-17784.1.patch Tentative first cut. > Make Tez AM's Queue headroom

[jira] [Updated] (HIVE-17784) Make Tez AM's Queue headroom calculation and nParallel tasks configurable.

2017-10-11 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17784: Description: Here's a couple of customizations we made at Yahoo with Hive Tez AMs: #

[jira] [Updated] (HIVE-17781) Map MR settings to Tez settings via DeprecatedKeys

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17781: Description: Here's one that [~cdrome] and [~thiruvel] worked on: We found that cer

[jira] [Reopened] (HIVE-17669) Cache to optimize SearchArgument deserialization

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reopened HIVE-17669: - Thank you for the heads-up, [~vihangk1]. I had a non-lambda version of this patch qu

[jira] [Comment Edited] (HIVE-17669) Cache to optimize SearchArgument deserialization

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202325#comment-16202325 ] Mithun Radhakrishnan edited comment on HIVE-17669 at 10/12/17 5:43 PM: -

[jira] [Commented] (HIVE-17669) Cache to optimize SearchArgument deserialization

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202347#comment-16202347 ] Mithun Radhakrishnan commented on HIVE-17669: - [~vihangk1]: I've reverted the

[jira] [Resolved] (HIVE-17669) Cache to optimize SearchArgument deserialization

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan resolved HIVE-17669. - Resolution: Fixed Fix Version/s: 2.2.1 > Cache to optimize SearchArgument d

[jira] [Assigned] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17791: --- > Temp dirs under the staging directory should honour `inheritPerms` > --

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Attachment: HIVE-17791.1.patch > Temp dirs under the staging directory should honour

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Status: Open (was: Patch Available) > Temp dirs under the staging directory should

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Attachment: (was: HIVE-17791.1.patch) > Temp dirs under the staging directory sh

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Affects Version/s: 2.4.0 2.2.0 Status: Patch Av

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Status: Patch Available (was: Open) > Temp dirs under the staging directory should

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Attachment: HIVE-17791.1-branch-2.patch > Temp dirs under the staging directory shou

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Attachment: HIVE-17791.1-branch-2.2.patch > Temp dirs under the staging directory sh

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Description: For [~cdrome]: CLI creates two levels of staging directories but calls

[jira] [Commented] (HIVE-16874) qurey fail when try to read file from remote hdfs

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202624#comment-16202624 ] Mithun Radhakrishnan commented on HIVE-16874: - [~thejas] is right. I think thi

[jira] [Commented] (HIVE-11116) Can not select data from table which points to remote hdfs location

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202630#comment-16202630 ] Mithun Radhakrishnan commented on HIVE-6: - [~sushanth] is right. This shou

[jira] [Updated] (HIVE-14380) Queries on tables with remote HDFS paths fail in "encryption" checks.

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-14380: Description: If a table has table/partition locations set to remote HDFS paths, quer

[jira] [Assigned] (HIVE-17794) HCatLoader breaks when a member is added to a struct-column of a table

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17794: --- > HCatLoader breaks when a member is added to a struct-column of a table > --

[jira] [Updated] (HIVE-17794) HCatLoader breaks when a member is added to a struct-column of a table

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17794: Status: Patch Available (was: Open) > HCatLoader breaks when a member is added to a

[jira] [Updated] (HIVE-17794) HCatLoader breaks when a member is added to a struct-column of a table

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17794: Attachment: HIVE-17794.1.patch > HCatLoader breaks when a member is added to a struc

[jira] [Resolved] (HIVE-16874) qurey fail when try to read file from remote hdfs

2017-10-12 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan resolved HIVE-16874. - Resolution: Duplicate Superb. Thanks for confirming, [~daniel.yj.zh...@gmail.com].

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-13 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Status: Open (was: Patch Available) Temporarily removing the {{branch-2.2}} patch,

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-13 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Attachment: (was: HIVE-17791.1-branch-2.2.patch) > Temp dirs under the staging d

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-13 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Status: Patch Available (was: Open) > Temp dirs under the staging directory should

[jira] [Assigned] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-13 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17802: --- > Remove unnecessary calls to FileSystem.setOwner() from > FileOutputCommitterCo

[jira] [Assigned] (HIVE-17803) With Pig multi-query, 2 HCatStorers writing to the same table will trample each other's outputs

2017-10-13 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17803: --- > With Pig multi-query, 2 HCatStorers writing to the same table will trample > e

[jira] [Updated] (HIVE-17803) With Pig multi-query, 2 HCatStorers writing to the same table will trample each other's outputs

2017-10-13 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17803: Status: Patch Available (was: Open) > With Pig multi-query, 2 HCatStorers writing t

[jira] [Updated] (HIVE-17803) With Pig multi-query, 2 HCatStorers writing to the same table will trample each other's outputs

2017-10-13 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17803: Attachment: HIVE-17803.1.patch > With Pig multi-query, 2 HCatStorers writing to the

[jira] [Commented] (HIVE-17803) With Pig multi-query, 2 HCatStorers writing to the same table will trample each other's outputs

2017-10-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206263#comment-16206263 ] Mithun Radhakrishnan commented on HIVE-17803: - The failing tests are old hat.

[jira] [Updated] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17802: Status: Patch Available (was: Open) > Remove unnecessary calls to FileSystem.setOwn

[jira] [Updated] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17802: Attachment: HIVE-17802.1.patch Cumulative patch with HIVE-17802, HIVE-17803, and par

[jira] [Commented] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-17 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16207980#comment-16207980 ] Mithun Radhakrishnan commented on HIVE-17802: - Back to the drawing board. :/ I

[jira] [Updated] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-17 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17802: Attachment: HIVE-17802.2.patch > Remove unnecessary calls to FileSystem.setOwner() f

[jira] [Commented] (HIVE-17747) HMS DropTableMessage should include the full table object

2017-10-18 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16209810#comment-16209810 ] Mithun Radhakrishnan commented on HIVE-17747: - I'm regret being late to this p

[jira] [Updated] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-18 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17802: Attachment: HIVE-17802.2-branch-2.patch > Remove unnecessary calls to FileSystem.set

[jira] [Updated] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-18 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17802: Attachment: (was: HIVE-17802.2-branch-2.patch) > Remove unnecessary calls to Fil

[jira] [Commented] (HIVE-15522) REPL LOAD & DUMP support for incremental ALTER_TABLE/ALTER_PTN including renames

2017-10-18 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210115#comment-16210115 ] Mithun Radhakrishnan commented on HIVE-15522: - With this change, {{AddPartitio

[jira] [Updated] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-18 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17802: Attachment: HIVE-17802.2-branch-2.patch > Remove unnecessary calls to FileSystem.set

[jira] [Commented] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-18 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210240#comment-16210240 ] Mithun Radhakrishnan commented on HIVE-17802: - I've uploaded the {{branch-2.2}

[jira] [Comment Edited] (HIVE-17802) Remove unnecessary calls to FileSystem.setOwner() from FileOutputCommitterContainer

2017-10-18 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210240#comment-16210240 ] Mithun Radhakrishnan edited comment on HIVE-17802 at 10/18/17 11:04 PM:

[jira] [Commented] (HIVE-17781) Map MR settings to Tez settings via DeprecatedKeys

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211391#comment-16211391 ] Mithun Radhakrishnan commented on HIVE-17781: - +1. Tests pass. Rebasing before

[jira] [Updated] (HIVE-17781) Map MR settings to Tez settings via DeprecatedKeys

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17781: Attachment: HIVE-17781.2.patch > Map MR settings to Tez settings via DeprecatedKeys

[jira] [Updated] (HIVE-17781) Map MR settings to Tez settings via DeprecatedKeys

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17781: Attachment: HIVE-17781.2-branch-2.2.patch HIVE-17781.2-branch-2.patch

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Status: Open (was: Patch Available) > Temp dirs under the staging directory should

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Attachment: HIVE-17791.2-branch-2.patch Rebasing the patch. > Temp dirs under the s

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Status: Patch Available (was: Open) > Temp dirs under the staging directory should

[jira] [Commented] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211426#comment-16211426 ] Mithun Radhakrishnan commented on HIVE-17791: - +1 on this change. I'll try squ

[jira] [Commented] (HIVE-17803) With Pig multi-query, 2 HCatStorers writing to the same table will trample each other's outputs

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211448#comment-16211448 ] Mithun Radhakrishnan commented on HIVE-17803: - Checked into {{master}}, {{bran

[jira] [Updated] (HIVE-17803) With Pig multi-query, 2 HCatStorers writing to the same table will trample each other's outputs

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17803: Resolution: Fixed Fix Version/s: 2.2.1 2.4.0

[jira] [Assigned] (HIVE-17853) RetryingMetaStoreClient loses UGI impersonation-context when reconnecting after timeout

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17853: --- > RetryingMetaStoreClient loses UGI impersonation-context when reconnecting > af

[jira] [Updated] (HIVE-17853) RetryingMetaStoreClient loses UGI impersonation-context when reconnecting after timeout

2017-10-19 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17853: Description: The {{RetryingMetaStoreClient}} is used to automatically reconnect to t

[jira] [Updated] (HIVE-17781) Map MR settings to Tez settings via DeprecatedKeys

2017-10-23 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17781: Resolution: Fixed Fix Version/s: 2.2.1 2.4.0

[jira] [Commented] (HIVE-17600) Make OrcFile's "enforceBufferSize" user-settable.

2017-10-26 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220979#comment-16220979 ] Mithun Radhakrishnan commented on HIVE-17600: - Hey, [~prasanth_j]. Sorry I mis

[jira] [Commented] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-26 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221299#comment-16221299 ] Mithun Radhakrishnan commented on HIVE-17791: - Committed to {{branch-2}}, and

[jira] [Updated] (HIVE-17791) Temp dirs under the staging directory should honour `inheritPerms`

2017-10-26 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17791: Resolution: Fixed Fix Version/s: 2.2.1 2.4.0 Sta

[jira] [Commented] (HIVE-10024) LLAP: q file test is broken again

2017-10-30 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225540#comment-16225540 ] Mithun Radhakrishnan commented on HIVE-10024: - I have put this off long enough

[jira] [Comment Edited] (HIVE-10024) LLAP: q file test is broken again

2017-10-30 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225540#comment-16225540 ] Mithun Radhakrishnan edited comment on HIVE-10024 at 10/30/17 6:53 PM: -

[jira] [Commented] (HIVE-10024) LLAP: q file test is broken again

2017-10-30 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225670#comment-16225670 ] Mithun Radhakrishnan commented on HIVE-10024: - bq. this was a branch fix so I

[jira] [Assigned] (HIVE-17940) IllegalArgumentException when reading last row-group in an ORC stripe

2017-10-30 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17940: --- > IllegalArgumentException when reading last row-group in an ORC stripe > ---

[jira] [Updated] (HIVE-17940) IllegalArgumentException when reading last row-group in an ORC stripe

2017-10-30 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17940: Description: (This is a backport of HIVE-10024 to {{branch-1.2}}, and {{branch-1}}.)

[jira] [Updated] (HIVE-17940) IllegalArgumentException when reading last row-group in an ORC stripe

2017-10-30 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17940: Attachment: HIVE-17940.1-branch-1.patch > IllegalArgumentException when reading last

[jira] [Updated] (HIVE-17940) IllegalArgumentException when reading last row-group in an ORC stripe

2017-10-30 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17940: Status: Patch Available (was: Open) > IllegalArgumentException when reading last ro

[jira] [Updated] (HIVE-17940) IllegalArgumentException when reading last row-group in an ORC stripe

2017-10-30 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17940: Attachment: HIVE-17940.1-branch-1.2.patch > IllegalArgumentException when reading la

[jira] [Commented] (HIVE-17940) IllegalArgumentException when reading last row-group in an ORC stripe

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227177#comment-16227177 ] Mithun Radhakrishnan commented on HIVE-17940: - How strange... {{branch-1.2}} b

[jira] [Commented] (HIVE-17853) RetryingMetaStoreClient loses UGI impersonation-context when reconnecting after timeout

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227401#comment-16227401 ] Mithun Radhakrishnan commented on HIVE-17853: - [~vihangk1], bq. All subsequen

[jira] [Commented] (HIVE-17940) IllegalArgumentException when reading last row-group in an ORC stripe

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227419#comment-16227419 ] Mithun Radhakrishnan commented on HIVE-17940: - bq. ... {{branch-1.2}} builds o

[jira] [Assigned] (HIVE-17949) itests compile is busted on branch-1.2

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan reassigned HIVE-17949: --- > itests compile is busted on branch-1.2 > --

[jira] [Updated] (HIVE-17949) itests compile is busted on branch-1.2

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17949: Attachment: HIVE-17949.01-branch-1.2.patch Here's the fix. Could I please bother eit

[jira] [Updated] (HIVE-17949) itests compile is busted on branch-1.2

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17949: Status: Patch Available (was: Open) Submitting for tests. > itests compile is bus

[jira] [Updated] (HIVE-17467) HCatClient APIs for discovering partition key-values

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17467: Attachment: HIVE-17467.2.patch > HCatClient APIs for discovering partition key-value

[jira] [Updated] (HIVE-17467) HCatClient APIs for discovering partition key-values

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17467: Affects Version/s: 2.4.0 3.0.0 Status: Patch Av

[jira] [Commented] (HIVE-17949) itests compile is busted on branch-1.2

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227758#comment-16227758 ] Mithun Radhakrishnan commented on HIVE-17949: - Thanks for the review, [~sershe

[jira] [Updated] (HIVE-17467) HCatClient APIs for discovering partition key-values

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17467: Attachment: HIVE-17467.2-branch-2.patch Periodic rebase. :/ > HCatClient APIs for d

[jira] [Commented] (HIVE-17853) RetryingMetaStoreClient loses UGI impersonation-context when reconnecting after timeout

2017-10-31 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16233534#comment-16233534 ] Mithun Radhakrishnan commented on HIVE-17853: - For the record, we've tested th

[jira] [Commented] (HIVE-17853) RetryingMetaStoreClient loses UGI impersonation-context when reconnecting after timeout

2017-11-01 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234314#comment-16234314 ] Mithun Radhakrishnan commented on HIVE-17853: - [~vihangk1], would you be avers

<    1   2   3   4   5   6   7   >