[jira] [Updated] (HIVE-6748) FileSinkOperator needs to cleanup held references for container reuse

2014-03-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-6748: -- Attachment: HIVE-6748.1.patch > FileSinkOperator needs to cleanup held references for container reuse >

[jira] [Updated] (HIVE-6748) FileSinkOperator needs to cleanup held references for container reuse

2014-03-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-6748: -- Release Note: FileSinkOperator cleanliness of references on closeOp/initializeOp Status: Patch Availab

[jira] [Created] (HIVE-6751) maxtaskfailures.per.node is set to too low a threshold

2014-03-25 Thread Gopal V (JIRA)
Gopal V created HIVE-6751: - Summary: maxtaskfailures.per.node is set to too low a threshold Key: HIVE-6751 URL: https://issues.apache.org/jira/browse/HIVE-6751 Project: Hive Issue Type: Bug

[jira] [Resolved] (HIVE-6751) maxtaskfailures.per.node is set to too low a threshold

2014-03-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-6751. --- Resolution: Invalid Should be a tez fix. > maxtaskfailures.per.node is set to too low a threshold > -

[jira] [Commented] (HIVE-6735) Make scalable dynamic partitioning work in vectorized mode

2014-03-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13948046#comment-13948046 ] Gopal V commented on HIVE-6735: --- The updated .2 patch runs in 859 seconds, where the previous

[jira] [Updated] (HIVE-6662) Vector Join operations with DATE columns fail

2014-03-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-6662: -- Release Note: Add VectorColumnAssignFactory methods to assign DATE into LongColumn vectors Status: Pat

[jira] [Updated] (HIVE-6662) Vector Join operations with DATE columns fail

2014-03-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-6662: -- Fix Version/s: 0.13.0 > Vector Join operations with DATE columns fail >

[jira] [Updated] (HIVE-6748) FileSinkOperator needs to cleanup held references for container reuse

2014-03-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-6748: -- Fix Version/s: 0.13.0 > FileSinkOperator needs to cleanup held references for container reuse >

[jira] [Created] (HIVE-6786) Off by one error in ORC PPD

2014-03-28 Thread Gopal V (JIRA)
Gopal V created HIVE-6786: - Summary: Off by one error in ORC PPD Key: HIVE-6786 URL: https://issues.apache.org/jira/browse/HIVE-6786 Project: Hive Issue Type: Bug Affects Versions: 0.13.0

[jira] [Updated] (HIVE-6786) Off by one error in ORC PPD

2014-03-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-6786: -- Fix Version/s: 0.13.0 > Off by one error in ORC PPD > > > Key: HIV

[jira] [Updated] (HIVE-6786) Off by one error in ORC PPD

2014-03-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-6786: -- Assignee: Prasanth J > Off by one error in ORC PPD > > > Key: HIVE

[jira] [Created] (HIVE-6787) ORC+ACID assumes all missing buckets are in ACID structure

2014-03-28 Thread Gopal V (JIRA)
Gopal V created HIVE-6787: - Summary: ORC+ACID assumes all missing buckets are in ACID structure Key: HIVE-6787 URL: https://issues.apache.org/jira/browse/HIVE-6787 Project: Hive Issue Type: Bug A

[jira] [Commented] (HIVE-6786) Off by one error in ORC PPD

2014-03-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13954713#comment-13954713 ] Gopal V commented on HIVE-6786: --- [~prasanth_j]: This is an old ORC 10Tb database which hasn't

[jira] [Commented] (HIVE-5067) Add bzip compressor for ORC

2014-04-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13959649#comment-13959649 ] Gopal V commented on HIVE-5067: --- Try increasing orc.compress.size to the bzip2's 900kb block

[jira] [Commented] (HIVE-5718) Support direct fetch for lateral views, sub queries, etc.

2014-07-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075992#comment-14075992 ] Gopal V commented on HIVE-5718: --- Sure [~navis]. Traveling at the moment, will do this mid-w

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-07-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Component/s: Tez > Changes related to TEZ-1288 (FastTezSerialization) >

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-07-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Affects Version/s: 0.14.0 > Changes related to TEZ-1288 (FastTezSerialization) > ---

[jira] [Resolved] (HIVE-7427) Changes for EdgeConfigurations

2014-08-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-7427. --- Resolution: Fixed Release Note: Committed to tez branch. > Changes for EdgeConfigurations >

[jira] [Created] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346

2014-08-03 Thread Gopal V (JIRA)
Gopal V created HIVE-7601: - Summary: Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346 Key: HIVE-7601 URL: https://issues.apache.org/jira/browse/HIVE-7601 Project: Hive Issu

[jira] [Updated] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041

2014-08-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7601: -- Summary: Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041 (was: Bring up te

[jira] [Updated] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041

2014-08-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7601: -- Attachment: HIVE-7601.1-tez.patch > Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346,

[jira] [Updated] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041

2014-08-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7601: -- Status: Patch Available (was: Open) > Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-134

[jira] [Commented] (HIVE-7589) Some fixes and improvements to statistics annotation rules

2014-08-04 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085461#comment-14085461 ] Gopal V commented on HIVE-7589: --- [~prasanth_j]: HIVE-7156 isn't critical. We can revisit it,

[jira] [Commented] (HIVE-5718) Support direct fetch for lateral views, sub queries, etc.

2014-08-04 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085851#comment-14085851 ] Gopal V commented on HIVE-5718: --- +1, LGTM. I suggest leaving some comments about the alias.s

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-08-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Release Note: TEZ-1288 related changes Status: Patch Available (was: Open) > Changes related to TEZ-1

[jira] [Created] (HIVE-7639) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

2014-08-06 Thread Gopal V (JIRA)
Gopal V created HIVE-7639: - Summary: Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382 Key: HIVE-7639 URL: https://issues.apache.org/jira/browse/HIVE-7639 Project: Hive Issue Type: S

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-08-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Description: Add ability to make use of TezBytesWritableSerialization. NO PRECOMMIT TESTS was:Add ability to

[jira] [Updated] (HIVE-7639) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

2014-08-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7639: -- Attachment: HIVE-7639.1-tez.patch [~rajesh.balamohan]: can you review these? > Bring tez-branch upto api change

[jira] [Updated] (HIVE-7639) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

2014-08-07 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7639: -- Status: Patch Available (was: Open) > Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382 > -

[jira] [Created] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-07 Thread Gopal V (JIRA)
Gopal V created HIVE-7656: - Summary: Bring tez-branch up-to the API changes made by TEZ-1372 Key: HIVE-7656 URL: https://issues.apache.org/jira/browse/HIVE-7656 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Attachment: HIVE-7656.1-tez.patch > Bring tez-branch up-to the API changes made by TEZ-1372 > --

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Fix Version/s: tez-branch Status: Patch Available (was: Open) > Bring tez-branch up-to the API chang

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372, TEZ-1386

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Summary: Bring tez-branch up-to the API changes made by TEZ-1372, TEZ-1386 (was: Bring tez-branch up-to the AP

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Status: Open (was: Patch Available) > Bring tez-branch up-to the API changes made by TEZ-1372 > ---

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Status: Patch Available (was: Open) > Bring tez-branch up-to the API changes made by TEZ-1372 > ---

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Summary: Bring tez-branch up-to the API changes made by TEZ-1372 (was: Bring tez-branch up-to the API changes m

[jira] [Commented] (HIVE-7696) small changes to mapjoin hashtable

2014-08-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094782#comment-14094782 ] Gopal V commented on HIVE-7696: --- Looks like the HiveQA Jenkins is no longer working for trunk

[jira] [Commented] (HIVE-7705) there's a useless threadlocal in LBUtils that shows up in perf profiles

2014-08-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095077#comment-14095077 ] Gopal V commented on HIVE-7705: --- Oh, in case anyone wants to dig into how ThreadLocals are ob

[jira] [Commented] (HIVE-7705) there's a useless threadlocal in LBUtils that shows up in perf profiles

2014-08-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095076#comment-14095076 ] Gopal V commented on HIVE-7705: --- [~sershe]: +1, assuming the QA setup is restored & tests run

[jira] [Commented] (HIVE-7696) small changes to mapjoin hashtable

2014-08-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096336#comment-14096336 ] Gopal V commented on HIVE-7696: --- LGTM - +1 > small changes to mapjoin hashtable > --

[jira] [Commented] (HIVE-7723) Explain plan for complex query with lots of partitions is slow due to in-efficient collection used to find a matching ReadEntity

2014-08-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096618#comment-14096618 ] Gopal V commented on HIVE-7723: --- [~mmokhtar]: Can you open a review ticket on reviews.apache.

[jira] [Updated] (HIVE-7617) optimize bytes mapjoin hash table read path wrt serialization, at least for common cases

2014-08-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7617: -- Attachment: hashmap-wb-fixes.png I find that this increased memory usage for small JOINs with this on my VM & I

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098974#comment-14098974 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: can you re-attach the same patch for the QA t

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Bring tez-branch up-to the API changes made

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099310#comment-14099310 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: I looked at the patch - you need to do {{git

[jira] [Updated] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7738: -- Description: if run this query using tez engine then hive will throw NPE {code} select sum(a) from ( select ca

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099459#comment-14099459 ] Gopal V commented on HIVE-7738: --- Looks like tests ran successfully, the one that failed is pr

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099885#comment-14099885 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: There is no need to attach the patch again -

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14101206#comment-14101206 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: LGTM +1 > tez select sum(decimal) from union

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103238#comment-14103238 ] Gopal V commented on HIVE-7664: --- [~navis]: I was originally planning to use VectorColumnAssig

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103254#comment-14103254 ] Gopal V commented on HIVE-7664: --- Sure [~navis], thanks for the work, I didn't want you to dup

[jira] [Updated] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7738: -- Resolution: Fixed Fix Version/s: 0.14.0 Release Note: tez select sum(decimal) from union all of decim

[jira] [Updated] (HIVE-7808) Changes to work against Tez-0.5 RC

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7808: -- Affects Version/s: tez-branch > Changes to work against Tez-0.5 RC > -- > >

[jira] [Created] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472

2014-08-20 Thread Gopal V (JIRA)
Gopal V created HIVE-7825: - Summary: Bring tez-branch up-to the API changes made by TEZ-1472 Key: HIVE-7825 URL: https://issues.apache.org/jira/browse/HIVE-7825 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7825: -- Summary: Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469 (was: Bring tez-branch up-to the API

[jira] [Updated] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7825: -- Attachment: HIVE-7825.1-tez.patch > Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469 >

[jira] [Resolved] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-7825. --- Resolution: Fixed Fix Version/s: tez-branch Committed to tez-branch, thanks [~sseth] > Bring tez-branc

[jira] [Commented] (HIVE-7833) Remove unwanted allocation in ORC RunLengthIntegerWriterV2 determine encoding function

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105941#comment-14105941 ] Gopal V commented on HIVE-7833: --- +1 > Remove unwanted allocation in ORC RunLengthIntegerWrit

[jira] [Commented] (HIVE-7808) Changes to work against Tez-0.5 RC

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105944#comment-14105944 ] Gopal V commented on HIVE-7808: --- The inc.2 patch was moved to HIVE-7825 and committed. > Cha

[jira] [Created] (HIVE-7838) Tez getProgress() should return number of failed attempts

2014-08-21 Thread Gopal V (JIRA)
Gopal V created HIVE-7838: - Summary: Tez getProgress() should return number of failed attempts Key: HIVE-7838 URL: https://issues.apache.org/jira/browse/HIVE-7838 Project: Hive Issue Type: Bug

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106554#comment-14106554 ] Gopal V commented on HIVE-7832: --- Minor refactoring comments on RB. LGTM +1, pending tests pa

[jira] [Created] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-08-22 Thread Gopal V (JIRA)
Gopal V created HIVE-7859: - Summary: Tune zlib compression in ORC to account for the encoding strategy Key: HIVE-7859 URL: https://issues.apache.org/jira/browse/HIVE-7859 Project: Hive Issue Type: B

[jira] [Commented] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14108222#comment-14108222 ] Gopal V commented on HIVE-7544: --- This needs rebasing to branch, after the last merge. > Chan

[jira] [Created] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
Gopal V created HIVE-7907: - Summary: Bring up tez branch to changes in TEZ-1038, TEZ-1500 Key: HIVE-7907 URL: https://issues.apache.org/jira/browse/HIVE-7907 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7907: -- Attachment: HIVE-7907.1-tez.patch > Bring up tez branch to changes in TEZ-1038, TEZ-1500 > -

[jira] [Commented] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114795#comment-14114795 ] Gopal V commented on HIVE-7907: --- [~hagleitn]/[~vikram.dixit]: can you take a look at this com

[jira] [Updated] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7907: -- Status: Patch Available (was: Open) > Bring up tez branch to changes in TEZ-1038, TEZ-1500 > --

[jira] [Commented] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114933#comment-14114933 ] Gopal V commented on HIVE-7907: --- Looks like this has to wait till the 0.5.0-SNAPSHOT gets upd

[jira] [Created] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
Gopal V created HIVE-7917: - Summary: Hive max reducers count has regressed from a prime number to 999 Key: HIVE-7917 URL: https://issues.apache.org/jira/browse/HIVE-7917 Project: Hive Issue Type: B

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: HIVE-7917.1.patch > Hive max reducers count has regressed from a prime number to 999 >

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116002#comment-14116002 ] Gopal V commented on HIVE-7832: --- I left some minor comments on RB - the extra configuration v

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: (was: HIVE-7917.1.patch) > Hive max reducers count has regressed from a prime number to 999 > -

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: HIVE-7917.1.patch > Hive max reducers count has regressed from a prime number to 999 >

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Release Note: Set hive.exec.reducers.max to a high prime number - 1009 Status: Patch Available (was: O

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116310#comment-14116310 ] Gopal V commented on HIVE-7832: --- +1 - TPC-H data loads went from 767 seconds to 540 seconds.

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127417#comment-14127417 ] Gopal V commented on HIVE-7950: --- Can you post the sequence of things you are doing? As in, h

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127479#comment-14127479 ] Gopal V commented on HIVE-7950: --- This is related to TEZ-1469, which should provide guidance.

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127910#comment-14127910 ] Gopal V commented on HIVE-7950: --- The basic part of the problem seems to have been solved, thi

[jira] [Updated] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7859: -- Attachment: HIVE-7859.1.patch > Tune zlib compression in ORC to account for the encoding strategy > -

[jira] [Assigned] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-7859: - Assignee: Gopal V > Tune zlib compression in ORC to account for the encoding strategy > --

[jira] [Updated] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7859: -- Attachment: HIVE-7859.2.patch Updated to work for uncompressed streams as well. > Tune zlib compression in ORC t

[jira] [Commented] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127946#comment-14127946 ] Gopal V commented on HIVE-7859: --- Tested this with TPC-H 1000 scale inserts. || Type || Time

[jira] [Commented] (HIVE-7926) long-lived daemons for query fragment execution, I/O and caching

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127965#comment-14127965 ] Gopal V commented on HIVE-7926: --- Hoare's 1985 CSP paper would make for good reading in this c

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14128768#comment-14128768 ] Gopal V commented on HIVE-8038: --- This is an interesting change-set. bq. 4a.If the split spa

[jira] [Commented] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129021#comment-14129021 ] Gopal V commented on HIVE-7859: --- I did try BEST_COMPRESSION, but without much improvement. T

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129205#comment-14129205 ] Gopal V commented on HIVE-8038: --- bq. Example : stripe size 512MB and BLOCK SIZE is 400MB, in

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129273#comment-14129273 ] Gopal V commented on HIVE-8038: --- Please open a reviews.apache.org reviewboard entry - also ad

[jira] [Commented] (HIVE-5170) Sorted Bucketed Partitioned Insert hard-codes the reducer count == bucket count

2013-09-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13774655#comment-13774655 ] Gopal V commented on HIVE-5170: --- Tried to do this, unfortunately the FileSinkOperator uses th

[jira] [Created] (HIVE-5345) Operator::close() leaks Operator::out, holding reference to buffers

2013-09-23 Thread Gopal V (JIRA)
Gopal V created HIVE-5345: - Summary: Operator::close() leaks Operator::out, holding reference to buffers Key: HIVE-5345 URL: https://issues.apache.org/jira/browse/HIVE-5345 Project: Hive Issue Type:

[jira] [Updated] (HIVE-5345) Operator::close() leaks Operator::out, holding reference to buffers

2013-09-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5345: -- Attachment: out-leak.png hprof analysis > Operator::close() leaks Operator::out, holding refere

[jira] [Updated] (HIVE-5345) Operator::close() leaks Operator::out, holding reference to buffers

2013-09-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5345: -- Attachment: HIVE-5345.01.patch One liner fix {code} @@ -613,6 +613,8 @@ public void close(boolean abort) throw

[jira] [Updated] (HIVE-5345) Operator::close() leaks Operator::out, holding reference to buffers

2013-09-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5345: -- Release Note: Prevent OutputCollector leaks from an Operator by clearing the Operator::out reference on close()

[jira] [Updated] (HIVE-5663) Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

2013-10-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5663: -- Labels: ORC (was: ) > Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers > --

[jira] [Created] (HIVE-5663) Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

2013-10-27 Thread Gopal V (JIRA)
Gopal V created HIVE-5663: - Summary: Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers Key: HIVE-5663 URL: https://issues.apache.org/jira/browse/HIVE-5663 Project: Hive Issue Type

[jira] [Updated] (HIVE-5663) Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

2013-10-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5663: -- Attachment: HIVE-5663.01.patch > Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers >

[jira] [Commented] (HIVE-5663) Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

2013-10-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13806815#comment-13806815 ] Gopal V commented on HIVE-5663: --- Ah, okay. I was just following the original code pattern, wh

[jira] [Updated] (HIVE-5663) Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

2013-10-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5663: -- Attachment: HIVE-5663.02.patch Updated patch as per comments. > Refactor ORC RecordReader to operate on direct

[jira] [Commented] (HIVE-5663) Refactor ORC RecordReader to operate on direct & wrapped ByteBuffers

2013-10-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13809169#comment-13809169 ] Gopal V commented on HIVE-5663: --- Opened review request - https://reviews.apache.org/r/15097/

[jira] [Commented] (HIVE-5692) Make VectorGroupByOperator parameters configurable

2013-11-11 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13819191#comment-13819191 ] Gopal V commented on HIVE-5692: --- [~ashutoshc] I ran into this in our tests and the fastest v

[jira] [Commented] (HIVE-8584) Setting hive.exec.orc.default.compress to ZLIB will lead to orc file size delta byte(s) shorter on Windows than Linux

2014-10-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14182369#comment-14182369 ] Gopal V commented on HIVE-8584: --- Zlib uses the java.util.zip.* libraries (not the libhadoop.s

<    2   3   4   5   6   7   8   9   10   11   >