[jira] [Commented] (HIVE-8153) Reduce the verbosity of debug logs in ORC record reader

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136545#comment-14136545 ] Gopal V commented on HIVE-8153: --- LGTM - +1 Reduce the verbosity of debug logs in ORC record

[jira] [Commented] (HIVE-8143) Create root scratch dir with 733 instead of 777 perms

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136675#comment-14136675 ] Gopal V commented on HIVE-8143: --- +1 - works with 777 and 733 /tmp/hive dirs. Create root

[jira] [Created] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
Gopal V created HIVE-8156: - Summary: Vectorized reducers need to avoid memory build-up during a single key Key: HIVE-8156 URL: https://issues.apache.org/jira/browse/HIVE-8156 Project: Hive Issue

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Attachment: HIVE-8156.1.patch Vectorized reducers need to avoid memory build-up during a single key

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Release Note: Cleanup memory within the vectorized reducer loop Status: Patch Available (was: Open)

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Status: Open (was: Patch Available) Vectorized reducers need to avoid memory build-up during a single key

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Attachment: HIVE-8156.2.patch Vectorized reducers need to avoid memory build-up during a single key

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Status: Patch Available (was: Open) Vectorized reducers need to avoid memory build-up during a single key

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14134389#comment-14134389 ] Gopal V commented on HIVE-8038: --- [~pankit]: Updated patch looks good, left one comment about

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Attachment: HIVE-8090.4.patch Updated patch to match coding standard. Please follow this next time send a

[jira] [Commented] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133362#comment-14133362 ] Gopal V commented on HIVE-8090: --- [~rpalamut]: You patch turns off this feature for ZlibCodec,

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Affects Version/s: 0.14.0 Potential null pointer reference in WriterImpl#StreamFactory#createStream()

[jira] [Commented] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133426#comment-14133426 ] Gopal V commented on HIVE-8090: --- Nice, that's what I meant - null implies no modifications.

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Priority: Minor (was: Major) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

[jira] [Commented] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131223#comment-14131223 ] Gopal V commented on HIVE-7156: --- I just re-ran my test with this patch applied the group-by

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132107#comment-14132107 ] Gopal V commented on HIVE-8038: --- Thanks [~pankit], left some minor comments on the RB. I

[jira] [Updated] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7156: -- Attachment: hive-debug.log.bz2 Group-By operator stat-annotation only uses distinct approx to generate

[jira] [Commented] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132519#comment-14132519 ] Gopal V commented on HIVE-7156: --- [~prasanth_j]: debug logs attached from my 1TB runs. The

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128768#comment-14128768 ] Gopal V commented on HIVE-8038: --- This is an interesting change-set. bq. 4a.If the split

[jira] [Commented] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129021#comment-14129021 ] Gopal V commented on HIVE-7859: --- I did try BEST_COMPRESSION, but without much improvement.

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129205#comment-14129205 ] Gopal V commented on HIVE-8038: --- bq. Example : stripe size 512MB and BLOCK SIZE is 400MB, in

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-10 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129273#comment-14129273 ] Gopal V commented on HIVE-8038: --- Please open a reviews.apache.org reviewboard entry - also

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127417#comment-14127417 ] Gopal V commented on HIVE-7950: --- Can you post the sequence of things you are doing? As in,

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127479#comment-14127479 ] Gopal V commented on HIVE-7950: --- This is related to TEZ-1469, which should provide guidance.

[jira] [Commented] (HIVE-7950) StorageHandler resources aren't added to Tez Session if already Session is already Open

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127910#comment-14127910 ] Gopal V commented on HIVE-7950: --- The basic part of the problem seems to have been solved,

[jira] [Updated] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7859: -- Attachment: HIVE-7859.1.patch Tune zlib compression in ORC to account for the encoding strategy

[jira] [Assigned] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-7859: - Assignee: Gopal V Tune zlib compression in ORC to account for the encoding strategy

[jira] [Updated] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7859: -- Attachment: HIVE-7859.2.patch Updated to work for uncompressed streams as well. Tune zlib compression in ORC

[jira] [Commented] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127946#comment-14127946 ] Gopal V commented on HIVE-7859: --- Tested this with TPC-H 1000 scale inserts. || Type || Time

[jira] [Commented] (HIVE-7926) long-lived daemons for query fragment execution, I/O and caching

2014-09-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127965#comment-14127965 ] Gopal V commented on HIVE-7926: --- Hoare's 1985 CSP paper would make for good reading in this

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116310#comment-14116310 ] Gopal V commented on HIVE-7832: --- +1 - TPC-H data loads went from 767 seconds to 540 seconds.

[jira] [Commented] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114933#comment-14114933 ] Gopal V commented on HIVE-7907: --- Looks like this has to wait till the 0.5.0-SNAPSHOT gets

[jira] [Created] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
Gopal V created HIVE-7917: - Summary: Hive max reducers count has regressed from a prime number to 999 Key: HIVE-7917 URL: https://issues.apache.org/jira/browse/HIVE-7917 Project: Hive Issue Type:

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: HIVE-7917.1.patch Hive max reducers count has regressed from a prime number to 999

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116002#comment-14116002 ] Gopal V commented on HIVE-7832: --- I left some minor comments on RB - the extra configuration

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: (was: HIVE-7917.1.patch) Hive max reducers count has regressed from a prime number to 999

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Attachment: HIVE-7917.1.patch Hive max reducers count has regressed from a prime number to 999

[jira] [Updated] (HIVE-7917) Hive max reducers count has regressed from a prime number to 999

2014-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7917: -- Release Note: Set hive.exec.reducers.max to a high prime number - 1009 Status: Patch Available (was:

[jira] [Created] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
Gopal V created HIVE-7907: - Summary: Bring up tez branch to changes in TEZ-1038, TEZ-1500 Key: HIVE-7907 URL: https://issues.apache.org/jira/browse/HIVE-7907 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7907: -- Attachment: HIVE-7907.1-tez.patch Bring up tez branch to changes in TEZ-1038, TEZ-1500

[jira] [Commented] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114795#comment-14114795 ] Gopal V commented on HIVE-7907: --- [~hagleitn]/[~vikram.dixit]: can you take a look at this

[jira] [Updated] (HIVE-7907) Bring up tez branch to changes in TEZ-1038, TEZ-1500

2014-08-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7907: -- Status: Patch Available (was: Open) Bring up tez branch to changes in TEZ-1038, TEZ-1500

[jira] [Commented] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108222#comment-14108222 ] Gopal V commented on HIVE-7544: --- This needs rebasing to branch, after the last merge.

[jira] [Commented] (HIVE-7832) Do ORC dictionary check at a finer level and preserve encoding across stripes

2014-08-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106554#comment-14106554 ] Gopal V commented on HIVE-7832: --- Minor refactoring comments on RB. LGTM +1, pending tests

[jira] [Created] (HIVE-7859) Tune zlib compression in ORC to account for the encoding strategy

2014-08-22 Thread Gopal V (JIRA)
Gopal V created HIVE-7859: - Summary: Tune zlib compression in ORC to account for the encoding strategy Key: HIVE-7859 URL: https://issues.apache.org/jira/browse/HIVE-7859 Project: Hive Issue Type:

[jira] [Resolved] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-7825. --- Resolution: Fixed Fix Version/s: tez-branch Committed to tez-branch, thanks [~sseth] Bring

[jira] [Commented] (HIVE-7833) Remove unwanted allocation in ORC RunLengthIntegerWriterV2 determine encoding function

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105941#comment-14105941 ] Gopal V commented on HIVE-7833: --- +1 Remove unwanted allocation in ORC

[jira] [Commented] (HIVE-7808) Changes to work against Tez-0.5 RC

2014-08-21 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105944#comment-14105944 ] Gopal V commented on HIVE-7808: --- The inc.2 patch was moved to HIVE-7825 and committed.

[jira] [Created] (HIVE-7838) Tez getProgress() should return number of failed attempts

2014-08-21 Thread Gopal V (JIRA)
Gopal V created HIVE-7838: - Summary: Tez getProgress() should return number of failed attempts Key: HIVE-7838 URL: https://issues.apache.org/jira/browse/HIVE-7838 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-7808) Changes to work against Tez-0.5 RC

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7808: -- Affects Version/s: tez-branch Changes to work against Tez-0.5 RC --

[jira] [Created] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472

2014-08-20 Thread Gopal V (JIRA)
Gopal V created HIVE-7825: - Summary: Bring tez-branch up-to the API changes made by TEZ-1472 Key: HIVE-7825 URL: https://issues.apache.org/jira/browse/HIVE-7825 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7825: -- Summary: Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469 (was: Bring tez-branch up-to the

[jira] [Updated] (HIVE-7825) Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7825: -- Attachment: HIVE-7825.1-tez.patch Bring tez-branch up-to the API changes made by TEZ-1472, TEZ-1469

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103238#comment-14103238 ] Gopal V commented on HIVE-7664: --- [~navis]: I was originally planning to use

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103254#comment-14103254 ] Gopal V commented on HIVE-7664: --- Sure [~navis], thanks for the work, I didn't want you to

[jira] [Updated] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7738: -- Resolution: Fixed Fix Version/s: 0.14.0 Release Note: tez select sum(decimal) from union all of

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101206#comment-14101206 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: LGTM +1 tez select sum(decimal) from union

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099885#comment-14099885 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: There is no need to attach the patch again -

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098974#comment-14098974 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: can you re-attach the same patch for the QA

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Resolution: Fixed Status: Resolved (was: Patch Available) Bring tez-branch up-to the API changes made

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099310#comment-14099310 ] Gopal V commented on HIVE-7738: --- [~apivovarov]: I looked at the patch - you need to do {{git

[jira] [Updated] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7738: -- Description: if run this query using tez engine then hive will throw NPE {code} select sum(a) from ( select

[jira] [Commented] (HIVE-7738) tez select sum(decimal) from union all of decimal and null throws NPE

2014-08-15 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099459#comment-14099459 ] Gopal V commented on HIVE-7738: --- Looks like tests ran successfully, the one that failed is

[jira] [Commented] (HIVE-7723) Explain plan for complex query with lots of partitions is slow due to in-efficient collection used to find a matching ReadEntity

2014-08-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096618#comment-14096618 ] Gopal V commented on HIVE-7723: --- [~mmokhtar]: Can you open a review ticket on

[jira] [Updated] (HIVE-7617) optimize bytes mapjoin hash table read path wrt serialization, at least for common cases

2014-08-14 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7617: -- Attachment: hashmap-wb-fixes.png I find that this increased memory usage for small JOINs with this on my VM I

[jira] [Commented] (HIVE-7696) small changes to mapjoin hashtable

2014-08-13 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096336#comment-14096336 ] Gopal V commented on HIVE-7696: --- LGTM - +1 small changes to mapjoin hashtable

[jira] [Commented] (HIVE-7696) small changes to mapjoin hashtable

2014-08-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094782#comment-14094782 ] Gopal V commented on HIVE-7696: --- Looks like the HiveQA Jenkins is no longer working for

[jira] [Commented] (HIVE-7705) there's a useless threadlocal in LBUtils that shows up in perf profiles

2014-08-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095077#comment-14095077 ] Gopal V commented on HIVE-7705: --- Oh, in case anyone wants to dig into how ThreadLocals are

[jira] [Commented] (HIVE-7705) there's a useless threadlocal in LBUtils that shows up in perf profiles

2014-08-12 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095076#comment-14095076 ] Gopal V commented on HIVE-7705: --- [~sershe]: +1, assuming the QA setup is restored tests run.

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Attachment: HIVE-7656.1-tez.patch Bring tez-branch up-to the API changes made by TEZ-1372

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Fix Version/s: tez-branch Status: Patch Available (was: Open) Bring tez-branch up-to the API

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372, TEZ-1386

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Summary: Bring tez-branch up-to the API changes made by TEZ-1372, TEZ-1386 (was: Bring tez-branch up-to the

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Status: Open (was: Patch Available) Bring tez-branch up-to the API changes made by TEZ-1372

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Status: Patch Available (was: Open) Bring tez-branch up-to the API changes made by TEZ-1372

[jira] [Updated] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7656: -- Summary: Bring tez-branch up-to the API changes made by TEZ-1372 (was: Bring tez-branch up-to the API changes

[jira] [Updated] (HIVE-7639) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

2014-08-07 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7639: -- Status: Patch Available (was: Open) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

[jira] [Created] (HIVE-7656) Bring tez-branch up-to the API changes made by TEZ-1372

2014-08-07 Thread Gopal V (JIRA)
Gopal V created HIVE-7656: - Summary: Bring tez-branch up-to the API changes made by TEZ-1372 Key: HIVE-7656 URL: https://issues.apache.org/jira/browse/HIVE-7656 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-08-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Release Note: TEZ-1288 related changes Status: Patch Available (was: Open) Changes related to

[jira] [Created] (HIVE-7639) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

2014-08-06 Thread Gopal V (JIRA)
Gopal V created HIVE-7639: - Summary: Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382 Key: HIVE-7639 URL: https://issues.apache.org/jira/browse/HIVE-7639 Project: Hive Issue Type:

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-08-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Description: Add ability to make use of TezBytesWritableSerialization. NO PRECOMMIT TESTS was:Add ability

[jira] [Updated] (HIVE-7639) Bring tez-branch upto api changes in TEZ-1379, TEZ-1057, TEZ-1382

2014-08-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7639: -- Attachment: HIVE-7639.1-tez.patch [~rajesh.balamohan]: can you review these? Bring tez-branch upto api

[jira] [Commented] (HIVE-5718) Support direct fetch for lateral views, sub queries, etc.

2014-08-05 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085851#comment-14085851 ] Gopal V commented on HIVE-5718: --- +1, LGTM. I suggest leaving some comments about the

[jira] [Commented] (HIVE-7589) Some fixes and improvements to statistics annotation rules

2014-08-04 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085461#comment-14085461 ] Gopal V commented on HIVE-7589: --- [~prasanth_j]: HIVE-7156 isn't critical. We can revisit it,

[jira] [Created] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346

2014-08-03 Thread Gopal V (JIRA)
Gopal V created HIVE-7601: - Summary: Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346 Key: HIVE-7601 URL: https://issues.apache.org/jira/browse/HIVE-7601 Project: Hive

[jira] [Updated] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041

2014-08-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7601: -- Summary: Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041 (was: Bring up

[jira] [Updated] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041

2014-08-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7601: -- Attachment: HIVE-7601.1-tez.patch Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346,

[jira] [Updated] (HIVE-7601) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303, TEZ-1346, TEZ-1041

2014-08-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7601: -- Status: Patch Available (was: Open) Bring up tez-branch upto the API changes from TEZ-1058, TEZ-1303,

[jira] [Resolved] (HIVE-7427) Changes for EdgeConfigurations

2014-08-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-7427. --- Resolution: Fixed Release Note: Committed to tez branch. Changes for EdgeConfigurations

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-07-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Component/s: Tez Changes related to TEZ-1288 (FastTezSerialization)

[jira] [Updated] (HIVE-7544) Changes related to TEZ-1288 (FastTezSerialization)

2014-07-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7544: -- Affects Version/s: 0.14.0 Changes related to TEZ-1288 (FastTezSerialization)

[jira] [Commented] (HIVE-5718) Support direct fetch for lateral views, sub queries, etc.

2014-07-28 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075992#comment-14075992 ] Gopal V commented on HIVE-5718: --- Sure [~navis]. Traveling at the moment, will do this

[jira] [Commented] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071793#comment-14071793 ] Gopal V commented on HIVE-7397: --- The test failures are unrelated. Set the default threshold

[jira] [Updated] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7397: -- Release Note: Set the simple fetch task conversion to more with a default threshold of 1Gb (was: Reduce the

[jira] [Updated] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7397: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks [~navis]. {code}

[jira] [Updated] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-7397: -- Attachment: HIVE-7397.5.patch Cannot reproduce the tez test failures on my machine. Re-uploading for a run

[jira] [Commented] (HIVE-7397) Set the default threshold for fetch task conversion to 1Gb

2014-07-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070267#comment-14070267 ] Gopal V commented on HIVE-7397: --- Will fix the null_scan test-case which needs a golden file

[jira] [Commented] (HIVE-7424) HiveException: Error evaluating concat(concat(' ', str2), ' ') in ql.exec.vector.VectorSelectOperator.processOp

2014-07-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065690#comment-14065690 ] Gopal V commented on HIVE-7424: --- Possibly related bug HiveException: Error evaluating

[jira] [Created] (HIVE-7428) OrcSplit fails to account for columnar projections in its size estimates

2014-07-16 Thread Gopal V (JIRA)
Gopal V created HIVE-7428: - Summary: OrcSplit fails to account for columnar projections in its size estimates Key: HIVE-7428 URL: https://issues.apache.org/jira/browse/HIVE-7428 Project: Hive Issue

[jira] [Created] (HIVE-7417) select count(1) from ... where true; fails in optimizer

2014-07-15 Thread Gopal V (JIRA)
Gopal V created HIVE-7417: - Summary: select count(1) from ... where true; fails in optimizer Key: HIVE-7417 URL: https://issues.apache.org/jira/browse/HIVE-7417 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-7402) add `approx_distinct` composable nDV UDAFs

2014-07-14 Thread Gopal V (JIRA)
Gopal V created HIVE-7402: - Summary: add `approx_distinct` composable nDV UDAFs Key: HIVE-7402 URL: https://issues.apache.org/jira/browse/HIVE-7402 Project: Hive Issue Type: New Feature

<    4   5   6   7   8   9   10   11   12   13   >