[jira] [Assigned] (HIVE-16702) Use LazyBinarySerDe for LLAP InputFormat

2017-05-17 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16702: - > Use LazyBinarySerDe for LLAP InputFormat > > >

[jira] [Updated] (HIVE-16691) Add test for more datatypes for LlapInputFormat

2017-05-16 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16691: -- Attachment: HIVE-16691.1.patch Updating test to use datatypes.txt. [~prasanth_j] can you take a look?

[jira] [Updated] (HIVE-16691) Add test for more datatypes for LlapInputFormat

2017-05-16 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16691: -- Status: Patch Available (was: Open) > Add test for more datatypes for LlapInputFormat >

[jira] [Assigned] (HIVE-16691) Add test for more datatypes for LlapInputFormat

2017-05-16 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16691: - > Add test for more datatypes for LlapInputFormat > ---

[jira] [Updated] (HIVE-16652) LlapInputFormat: Seeing "output error" WARN message

2017-05-12 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16652: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16651) LlapProtocolClientProxy stack trace when using llap input format

2017-05-12 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16651: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16652) LlapInputFormat: Seeing "output error" WARN message

2017-05-12 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16652: -- Status: Patch Available (was: Open) > LlapInputFormat: Seeing "output error" WARN message >

[jira] [Updated] (HIVE-16651) LlapProtocolClientProxy stack trace when using llap input format

2017-05-12 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16651: -- Status: Patch Available (was: Open) > LlapProtocolClientProxy stack trace when using llap input format

[jira] [Updated] (HIVE-16652) LlapInputFormat: Seeing "output error" WARN message

2017-05-12 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16652: -- Attachment: HIVE-16652.1.patch Patch to close external client after slight delay, to allow connection

[jira] [Commented] (HIVE-16652) LlapInputFormat: Seeing "output error" WARN message

2017-05-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006967#comment-16006967 ] Jason Dere commented on HIVE-16652: --- I suspect we may be closing the LlapTaskUmbilicalExternalClient and

[jira] [Assigned] (HIVE-16652) LlapInputFormat: Seeing "output error" WARN message

2017-05-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16652: - > LlapInputFormat: Seeing "output error" WARN message >

[jira] [Updated] (HIVE-16651) LlapProtocolClientProxy stack trace when using llap input format

2017-05-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16651: -- Attachment: HIVE-16651.1.patch Looks like this has to do with cancelling the requestManagerFuture in

[jira] [Assigned] (HIVE-16651) LlapProtocolClientProxy stack trace when using llap input format

2017-05-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16651: - > LlapProtocolClientProxy stack trace when using llap input format >

[jira] [Updated] (HIVE-16637) Improve end-of-data checking for LLAP input format

2017-05-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16637: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-12991 > Improve end-of-data checking for LLAP

[jira] [Reopened] (HIVE-16073) Fix partition column check during runtime filtering

2017-05-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reopened HIVE-16073: --- > Fix partition column check during runtime filtering >

[jira] [Resolved] (HIVE-16073) Fix partition column check during runtime filtering

2017-05-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere resolved HIVE-16073. --- Resolution: Duplicate > Fix partition column check during runtime filtering >

[jira] [Updated] (HIVE-16637) Improve end-of-data checking for LLAP input format

2017-05-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16637: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16610) Semijoin Hint : Should be able to handle more than one hint per alias

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16610: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16637) Improve end-of-data checking for LLAP input format

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16637: -- Attachment: HIVE-16637.2.patch It is not necessarily an EOF error there, fixing the error message in

[jira] [Comment Edited] (HIVE-16637) Improve end-of-data checking for LLAP input format

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005518#comment-16005518 ] Jason Dere edited comment on HIVE-16637 at 5/10/17 9:54 PM: I think for this

[jira] [Commented] (HIVE-16637) Improve end-of-data checking for LLAP input format

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005518#comment-16005518 ] Jason Dere commented on HIVE-16637: --- I think for this to work (basically, for the ChunkedInputStream

[jira] [Commented] (HIVE-16610) Semijoin Hint : Should be able to handle more than one hint per alias

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005436#comment-16005436 ] Jason Dere commented on HIVE-16610: --- +1 pending test results > Semijoin Hint : Should be able to handle

[jira] [Commented] (HIVE-16637) Improve end-of-data checking for LLAP input format

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005425#comment-16005425 ] Jason Dere commented on HIVE-16637: --- Whoops, forgot to link the RB: https://reviews.apache.org/r/59152/

[jira] [Updated] (HIVE-16637) Improve end-of-data checking for LLAP input format

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16637: -- Status: Patch Available (was: Open) > Improve end-of-data checking for LLAP input format >

[jira] [Updated] (HIVE-16637) Improve end-of-data checking for LLAP input format

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16637: -- Attachment: HIVE-16637.1.patch Fix the way we check end of data in LlapBaseRecordReader.next(). Also

[jira] [Assigned] (HIVE-16637) Improve end-of-data checking for LLAP input format

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16637: - > Improve end-of-data checking for LLAP input format >

[jira] [Updated] (HIVE-16599) NPE in runtime filtering cost when handling SMB Joins

2017-05-10 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16599: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16599) NPE in runtime filtering cost when handling SMB Joins

2017-05-09 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003856#comment-16003856 ] Jason Dere commented on HIVE-16599: --- +1 > NPE in runtime filtering cost when handling SMB Joins >

[jira] [Updated] (HIVE-16568) Support complex types in external LLAP InputFormat

2017-05-08 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16568: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16578) Semijoin Hints should use column name, if provided for partition key check

2017-05-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16578: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16568) Support complex types in external LLAP InputFormat

2017-05-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16568: -- Attachment: HIVE-16568.3.patch Check for negative list/map size per [~prasanth_j]'s comments. >

[jira] [Updated] (HIVE-16568) Support complex types in external LLAP InputFormat

2017-05-04 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16568: -- Attachment: HIVE-16568.2.patch Trying changes per [~prasanth_j] feedback - using TypeInfo rather than

[jira] [Commented] (HIVE-16578) Semijoin Hints should use column name, if provided for partition key check

2017-05-04 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997387#comment-15997387 ] Jason Dere commented on HIVE-16578: --- +1 pending test results > Semijoin Hints should use column name,

[jira] [Updated] (HIVE-16550) Semijoin Hints should be able to skip the optimization if needed.

2017-05-03 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16550: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16550) Semijoin Hints should be able to skip the optimization if needed.

2017-05-02 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994147#comment-15994147 ] Jason Dere commented on HIVE-16550: --- +1 pending tests > Semijoin Hints should be able to skip the

[jira] [Commented] (HIVE-16568) Support complex types in external LLAP InputFormat

2017-05-02 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994136#comment-15994136 ] Jason Dere commented on HIVE-16568: --- This might increase memory overhead, certainly in the case of

[jira] [Commented] (HIVE-16568) Support complex types in external LLAP InputFormat

2017-05-02 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993860#comment-15993860 ] Jason Dere commented on HIVE-16568: --- RB at https://reviews.apache.org/r/58934/ [~hagleitn] [~sseth]

[jira] [Updated] (HIVE-16568) Support complex types in external LLAP InputFormat

2017-05-02 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16568: -- Status: Patch Available (was: Open) > Support complex types in external LLAP InputFormat >

[jira] [Updated] (HIVE-16568) Support complex types in external LLAP InputFormat

2017-05-02 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16568: -- Attachment: HIVE-16568.1.patch > Support complex types in external LLAP InputFormat >

[jira] [Assigned] (HIVE-16568) Support complex types in external LLAP InputFormat

2017-05-02 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16568: - > Support complex types in external LLAP InputFormat >

[jira] [Updated] (HIVE-16553) Change default value for hive.tez.bigtable.minsize.semijoin.reduction

2017-04-28 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16553: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16553) Change default value for hive.tez.bigtable.minsize.semijoin.reduction

2017-04-27 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16553: -- Status: Patch Available (was: Open) > Change default value for

[jira] [Updated] (HIVE-16553) Change default value for hive.tez.bigtable.minsize.semijoin.reduction

2017-04-27 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16553: -- Attachment: HIVE-16553.1.patch Whoops, didn't post the patch! posting now > Change default value for

[jira] [Commented] (HIVE-16553) Change default value for hive.tez.bigtable.minsize.semijoin.reduction

2017-04-27 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987794#comment-15987794 ] Jason Dere commented on HIVE-16553: --- [~hagleitn] [~gopalv] can you review? Just a simple default config

[jira] [Assigned] (HIVE-16553) Change default value for hive.tez.bigtable.minsize.semijoin.reduction

2017-04-27 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16553: - > Change default value for hive.tez.bigtable.minsize.semijoin.reduction >

[jira] [Updated] (HIVE-16441) De-duplicate semijoin branches in n-way joins

2017-04-24 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16441: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16423) Add hint to enforce semi join optimization

2017-04-20 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16423: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Looks

[jira] [Updated] (HIVE-16423) Add hint to enforce semi join optimization

2017-04-20 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16423: -- Issue Type: Improvement (was: Task) > Add hint to enforce semi join optimization >

[jira] [Commented] (HIVE-16423) Add hint to enforce semi join optimization

2017-04-19 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975815#comment-15975815 ] Jason Dere commented on HIVE-16423: --- +1 pending test results > Add hint to enforce semi join

[jira] [Updated] (HIVE-16462) Vectorization: Enabling hybrid grace disables specialization of all reduce side joins

2017-04-18 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16462: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16462) Vectorization: Enabling hybrid grace disables specialization of all reduce side joins

2017-04-18 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16462: -- Attachment: HIVE-16462.2.patch Changing a debug message: {noformat} - LOG.debug("Skipping llap

[jira] [Updated] (HIVE-16462) Vectorization: Enabling hybrid grace disables specialization of all reduce side joins

2017-04-17 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16462: -- Attachment: HIVE-16462.1.patch > Vectorization: Enabling hybrid grace disables specialization of all

[jira] [Updated] (HIVE-16462) Vectorization: Enabling hybrid grace disables specialization of all reduce side joins

2017-04-17 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16462: -- Status: Patch Available (was: Open) > Vectorization: Enabling hybrid grace disables specialization of

[jira] [Assigned] (HIVE-16462) Vectorization: Enabling hybrid grace disables specialization of all reduce side joins

2017-04-17 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16462: - > Vectorization: Enabling hybrid grace disables specialization of all reduce > side joins >

[jira] [Updated] (HIVE-16386) Add debug logging to describe why runtime filtering semijoins are removed

2017-04-11 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16386: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16341) Tez Task Execution Summary has incorrect input record counts on some operators

2017-04-06 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16341: -- Fix Version/s: 2.3.0 > Tez Task Execution Summary has incorrect input record counts on some operators >

[jira] [Comment Edited] (HIVE-16341) Tez Task Execution Summary has incorrect input record counts on some operators

2017-04-06 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959640#comment-15959640 ] Jason Dere edited comment on HIVE-16341 at 4/6/17 8:52 PM: --- Committed to

[jira] [Updated] (HIVE-16341) Tez Task Execution Summary has incorrect input record counts on some operators

2017-04-06 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16341: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16386) Add debug logging to describe why runtime filtering semijoins are removed

2017-04-06 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16386: -- Attachment: HIVE-16386.2.patch Adding additional logging for semijoin removal during

[jira] [Commented] (HIVE-16386) Add debug logging to describe why runtime filtering semijoins are removed

2017-04-06 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959492#comment-15959492 ] Jason Dere commented on HIVE-16386: --- [~prasanth_j], can you review? just adding logging statements >

[jira] [Commented] (HIVE-16341) Tez Task Execution Summary has incorrect input record counts on some operators

2017-04-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957358#comment-15957358 ] Jason Dere commented on HIVE-16341: --- [~gopalv] does the newer patch look more acceptable? > Tez Task

[jira] [Updated] (HIVE-16386) Add debug logging to describe why runtime filtering semijoins are removed

2017-04-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16386: -- Attachment: HIVE-16386.1.patch > Add debug logging to describe why runtime filtering semijoins are

[jira] [Updated] (HIVE-16386) Add debug logging to describe why runtime filtering semijoins are removed

2017-04-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16386: -- Status: Patch Available (was: Open) > Add debug logging to describe why runtime filtering semijoins

[jira] [Assigned] (HIVE-16386) Add debug logging to describe why runtime filtering semijoins are removed

2017-04-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16386: - > Add debug logging to describe why runtime filtering semijoins are removed >

[jira] [Updated] (HIVE-16341) Tez Task Execution Summary has incorrect input record counts on some operators

2017-03-31 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16341: -- Attachment: HIVE-16341.2.patch Tried checking for tez.task.generate.counters.per.io, but this did not

[jira] [Updated] (HIVE-16341) Tez Task Execution Summary has incorrect input record counts on some operators

2017-03-30 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16341: -- Status: Patch Available (was: Open) > Tez Task Execution Summary has incorrect input record counts on

[jira] [Updated] (HIVE-16341) Tez Task Execution Summary has incorrect input record counts on some operators

2017-03-30 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16341: -- Attachment: HIVE-16341.1.patch It looks like there are Tez counters which show the # output records

[jira] [Assigned] (HIVE-16341) Tez Task Execution Summary has incorrect input record counts on some operators

2017-03-30 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16341: - > Tez Task Execution Summary has incorrect input record counts on some operators >

[jira] [Commented] (HIVE-16311) Improve the performance for FastHiveDecimalImpl.fastDivide

2017-03-29 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947871#comment-15947871 ] Jason Dere commented on HIVE-16311: --- Hey [~mmccline], the rules related to result precision/scale for

[jira] [Updated] (HIVE-16298) Add config to specify multi-column joins have correlated columns

2017-03-25 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16298: -- Attachment: HIVE-16298.2.patch > Add config to specify multi-column joins have correlated columns >

[jira] [Commented] (HIVE-16298) Add config to specify multi-column joins have correlated columns

2017-03-25 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941975#comment-15941975 ] Jason Dere commented on HIVE-16298: --- I just followed the convention that was followed on the params

[jira] [Commented] (HIVE-16274) Support tuning of NDV of columns using lower/upper bounds

2017-03-25 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941973#comment-15941973 ] Jason Dere commented on HIVE-16274: --- [~pxiong], looks like some of these failures are related. Do the

[jira] [Updated] (HIVE-16282) Semijoin: Disable slow-start for the bloom filter aggregate task

2017-03-25 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16282: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16274) Support tuning of NDV of columns using lower/upper bounds

2017-03-24 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941487#comment-15941487 ] Jason Dere commented on HIVE-16274: --- +1 > Support tuning of NDV of columns using lower/upper bounds >

[jira] [Updated] (HIVE-16298) Add config to specify multi-column joins have correlated columns

2017-03-24 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16298: -- Status: Patch Available (was: Open) > Add config to specify multi-column joins have correlated columns

[jira] [Updated] (HIVE-16298) Add config to specify multi-column joins have correlated columns

2017-03-24 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16298: -- Attachment: HIVE-16298.1.patch Attaching patch. [~prasanth_j] [~ashutoshc] can you take a look? > Add

[jira] [Assigned] (HIVE-16298) Add config to specify multi-column joins have correlated columns

2017-03-24 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16298: - > Add config to specify multi-column joins have correlated columns >

[jira] [Commented] (HIVE-16273) Vectorization: Make non-column key expressions work in MERGEPARTIAL mode

2017-03-24 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940658#comment-15940658 ] Jason Dere commented on HIVE-16273: --- +1 > Vectorization: Make non-column key expressions work in

[jira] [Commented] (HIVE-16274) Support tuning of NDV of columns using lower/upper bounds

2017-03-23 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939290#comment-15939290 ] Jason Dere commented on HIVE-16274: --- Unfortunately this scales the nDV of all column in the same way,

[jira] [Updated] (HIVE-16274) Support tuning of NDV of columns using lower/upper bounds

2017-03-23 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16274: -- Description: For partitioned tables, the distinct value (nDV) estimate for a column is by default set

[jira] [Updated] (HIVE-16154) Determine when dynamic runtime filtering should be disabled

2017-03-23 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16154: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16154) Determine when dynamic runtime filtering should be disabled

2017-03-23 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16154: -- Attachment: HIVE-16154.4.patch Rebasing patch after HIVE-16260 > Determine when dynamic runtime

[jira] [Updated] (HIVE-16260) Remove parallel edges of semijoin with map joins.

2017-03-23 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16260: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16154) Determine when dynamic runtime filtering should be disabled

2017-03-22 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16154: -- Attachment: HIVE-16154.3.patch Needed to update golden file for the explain* tests in MiniTez >

[jira] [Commented] (HIVE-16260) Remove parallel edges of semijoin with map joins.

2017-03-22 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936211#comment-15936211 ] Jason Dere commented on HIVE-16260: --- +1 > Remove parallel edges of semijoin with map joins. >

[jira] [Updated] (HIVE-16154) Determine when dynamic runtime filtering should be disabled

2017-03-22 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16154: -- Attachment: HIVE-16154.2.patch Few changes to the patch: - Do cost/benefit check of semijoin

[jira] [Commented] (HIVE-16245) Vectorization: Does not handle non-column key expressions in MERGEPARTIAL mode

2017-03-17 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930897#comment-15930897 ] Jason Dere commented on HIVE-16245: --- +1 pending test results > Vectorization: Does not handle

[jira] [Commented] (HIVE-16216) update trunk/content/people.mdtext

2017-03-16 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928683#comment-15928683 ] Jason Dere commented on HIVE-16216: --- +1 > update trunk/content/people.mdtext >

[jira] [Updated] (HIVE-16211) MERGE statement failing with ClassCastException

2017-03-16 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16211: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available) I've

[jira] [Updated] (HIVE-16154) Determine when dynamic runtime filtering should be disabled

2017-03-09 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16154: -- Attachment: HIVE-16154.1.patch Initial patch to compute benefit based on the selectivity of the

[jira] [Updated] (HIVE-16154) Determine when dynamic runtime filtering should be disabled

2017-03-09 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16154: -- Status: Patch Available (was: Open) > Determine when dynamic runtime filtering should be disabled >

[jira] [Assigned] (HIVE-16154) Determine when dynamic runtime filtering should be disabled

2017-03-09 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere reassigned HIVE-16154: - > Determine when dynamic runtime filtering should be disabled >

[jira] [Commented] (HIVE-16142) ATSHook NPE via LLAP

2017-03-08 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901878#comment-15901878 ] Jason Dere commented on HIVE-16142: --- I believe the same fix needs to apply to the changes that were done

[jira] [Commented] (HIVE-16065) Vectorization: Wrong Key/Value information used by Vectorizer

2017-03-02 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893603#comment-15893603 ] Jason Dere commented on HIVE-16065: --- +1 pending tests > Vectorization: Wrong Key/Value information used

[jira] [Commented] (HIVE-15818) Union of complex data types and NULL

2017-03-01 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890908#comment-15890908 ] Jason Dere commented on HIVE-15818: --- Is this solved by HIVE-16050? > Union of complex data types and

[jira] [Updated] (HIVE-16068) BloomFilter expectedEntries not always using NDV when it's available during runtime filtering

2017-03-01 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16068: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16068) BloomFilter expectedEntries not always using NDV when it's available during runtime filtering

2017-03-01 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16068: -- Status: Patch Available (was: Open) > BloomFilter expectedEntries not always using NDV when it's

[jira] [Comment Edited] (HIVE-16073) Fix partition column check during runtime filtering

2017-03-01 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889789#comment-15889789 ] Jason Dere edited comment on HIVE-16073 at 3/1/17 8:50 AM: --- Patch to remove the

[jira] [Updated] (HIVE-16073) Fix partition column check during runtime filtering

2017-03-01 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16073: -- Status: Patch Available (was: Open) > Fix partition column check during runtime filtering >

[jira] [Updated] (HIVE-16073) Fix partition column check during runtime filtering

2017-03-01 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16073: -- Attachment: HIVE-16073.1.patch Patch to remove the partition column checking, to see why this check was

<    6   7   8   9   10   11   12   13   14   15   >