[jira] [Commented] (HIVE-8292) Reading from partitioned bucketed tables has high overhead in MapOperator.cleanUpInputFileChangedOp

2014-10-03 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14158966#comment-14158966 ] Gopal V commented on HIVE-8292: --- Traced it down to {code} @Override public boolean

[jira] [Updated] (HIVE-8328) MapJoin implementation in Tez should not reload hashtables

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8328: -- Attachment: HIVE-8328.WIP.patch This fixes the symptoms at least. MapJoin implementation in Tez should not

[jira] [Commented] (HIVE-8304) Tez Reduce-Side GROUP BY Vectorization doesn't copy NULL keys correctly

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156147#comment-14156147 ] Gopal V commented on HIVE-8304: --- The HCatLoader errors are there in nearly all runs today.

[jira] [Commented] (HIVE-8240) VectorColumnAssignFactory throws Incompatible Bytes vector column and primitive category VARCHAR

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156181#comment-14156181 ] Gopal V commented on HIVE-8240: --- Test failures are unrelated. VectorColumnAssignFactory

[jira] [Updated] (HIVE-8304) Tez Reduce-Side GROUP BY Vectorization doesn't copy NULL keys correctly

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8304: -- Resolution: Fixed Release Note: HIVE-8304: Tez Reduce-Side GROUP BY Vectorization doesn't copy NULL keys

[jira] [Commented] (HIVE-8304) Tez Reduce-Side GROUP BY Vectorization doesn't copy NULL keys correctly

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157176#comment-14157176 ] Gopal V commented on HIVE-8304: --- Committed to branch-14. Tez Reduce-Side GROUP BY

[jira] [Updated] (HIVE-8240) VectorColumnAssignFactory throws Incompatible Bytes vector column and primitive category VARCHAR

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8240: -- Resolution: Fixed Release Note: HIVE-8240: VectorColumnAssignFactory support for VARCHAR (Matt McCline,

[jira] [Commented] (HIVE-8240) VectorColumnAssignFactory throws Incompatible Bytes vector column and primitive category VARCHAR

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157398#comment-14157398 ] Gopal V commented on HIVE-8240: --- Thanks [~mmccline] [~vikram.dixit]!

[jira] [Commented] (HIVE-8335) TestHCatLoader/TestHCatStorer failures on pre-commit tests

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157620#comment-14157620 ] Gopal V commented on HIVE-8335: --- There is no way to fix public method resolution while

[jira] [Commented] (HIVE-8271) Jackson incompatibility between hadoop-2.4 and hive-14

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157621#comment-14157621 ] Gopal V commented on HIVE-8271: --- We should revert this move to hadoop-2.5 instead

[jira] [Updated] (HIVE-8327) mvn site -Pfindbugs

2014-10-02 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8327: -- Attachment: HIVE-8327.1.patch mvn site -Pfindbugs --- Key: HIVE-8327

[jira] [Commented] (HIVE-7664) VectorizedBatchUtil.addRowToBatchFrom is not optimized for Vectorized execution and takes 25% CPU

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155043#comment-14155043 ] Gopal V commented on HIVE-7664: --- Nope. Functional issues need to be all resolved before

[jira] [Updated] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8236: -- Resolution: Fixed Release Note: HIVE-8236: VectorHashKeyWrapper allocates too many zero sized arrays

[jira] [Commented] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155107#comment-14155107 ] Gopal V commented on HIVE-8236: --- Committed to trunk and hive-14, thanks [~prasanth_j]

[jira] [Updated] (HIVE-8271) Jackson incompatibility between hadoop-2.4 and hive-14

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8271: -- Resolution: Fixed Release Note: HIVE-8271: Relocate jackson within hive-exec.jar for hadoop-2.4 compat

[jira] [Commented] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155450#comment-14155450 ] Gopal V commented on HIVE-7156: --- [~xuefuz]: That variable defaults to map.container.size

[jira] [Commented] (HIVE-8240) VectorColumnAssignFactory throws Incompatible Bytes vector column and primitive category VARCHAR

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155504#comment-14155504 ] Gopal V commented on HIVE-8240: --- [~mmccline]: Can you reupload this patch, the Jenkins job

[jira] [Commented] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1414#comment-1414 ] Gopal V commented on HIVE-7156: --- bq. My point is, it's probably better if we have clean code

[jira] [Created] (HIVE-8327) mvn site -Pfindbugs

2014-10-01 Thread Gopal V (JIRA)
Gopal V created HIVE-8327: - Summary: mvn site -Pfindbugs Key: HIVE-8327 URL: https://issues.apache.org/jira/browse/HIVE-8327 Project: Hive Issue Type: Test Components: Diagnosability

[jira] [Updated] (HIVE-8327) mvn site -Pfindbugs

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8327: -- Attachment: ql-findbugs.html Example output run. mvn site -Pfindbugs ---

[jira] [Updated] (HIVE-8296) Tez ReduceShuffle Vectorization needs 2 data buffers (key and value) for adding rows

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8296: -- Resolution: Fixed Release Note: HIVE-8296: Reduce vectorization should use independent buffers for key and

[jira] [Created] (HIVE-8328) TezCacheAccess needs to cache Vertex objects in-memory

2014-10-01 Thread Gopal V (JIRA)
Gopal V created HIVE-8328: - Summary: TezCacheAccess needs to cache Vertex objects in-memory Key: HIVE-8328 URL: https://issues.apache.org/jira/browse/HIVE-8328 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8328) TezCacheAccess needs to cache Vertex objects in-memory

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8328: -- Labels: Regression (was: ) TezCacheAccess needs to cache Vertex objects in-memory

[jira] [Assigned] (HIVE-8328) TezCacheAccess needs to cache Vertex objects in-memory

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-8328: - Assignee: Gopal V TezCacheAccess needs to cache Vertex objects in-memory

[jira] [Updated] (HIVE-8328) MapJoin implementation in Tez should not reload hashtables

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8328: -- Summary: MapJoin implementation in Tez should not reload hashtables (was: TezCacheAccess needs to cache Vertex

[jira] [Updated] (HIVE-8328) MapJoin implementation in Tez should not reload hashtables

2014-10-01 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8328: -- Description: {code} private void loadHashTable() throws HiveException { if ((this.getExecContext() !=

[jira] [Resolved] (HIVE-7293) Hive-trunk does not build against JDK8 with generic class checks

2014-09-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V resolved HIVE-7293. --- Resolution: Not a Problem Builds are succeeding on JDK8. Hive-trunk does not build against JDK8 with generic

[jira] [Commented] (HIVE-8296) Tez ReduceShuffle Vectorization needs 2 data buffers (key and value) for adding rows

2014-09-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153580#comment-14153580 ] Gopal V commented on HIVE-8296: --- LGTM - +1. [~vikram.dixit]: this is necessary for 0.14 over

[jira] [Updated] (HIVE-8304) Tez Reduce-Side GROUP BY Vectorization doesn't copy NULL keys correctly

2014-09-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8304: -- Status: Patch Available (was: Open) Tez Reduce-Side GROUP BY Vectorization doesn't copy NULL keys correctly

[jira] [Updated] (HIVE-8304) Tez Reduce-Side GROUP BY Vectorization doesn't copy NULL keys correctly

2014-09-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8304: -- Attachment: HIVE-8304.2.patch Reupload for the unit tests to pick up the right file. Tez Reduce-Side GROUP BY

[jira] [Commented] (HIVE-8304) Tez Reduce-Side GROUP BY Vectorization doesn't copy NULL keys correctly

2014-09-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154230#comment-14154230 ] Gopal V commented on HIVE-8304: --- Patch LGTM, but it is confusing to read the {code}

[jira] [Commented] (HIVE-8304) Tez Reduce-Side GROUP BY Vectorization doesn't copy NULL keys correctly

2014-09-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154234#comment-14154234 ] Gopal V commented on HIVE-8304: --- +1, tests pending - [~vikram.dixit], this is aimed at 0.14

[jira] [Updated] (HIVE-8283) Missing break in FilterSelectivityEstimator#visitCall()

2014-09-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8283: -- Affects Version/s: 0.14.0 Missing break in FilterSelectivityEstimator#visitCall()

[jira] [Created] (HIVE-8294) Hive-on-Tez is going into MapOperator::cleanUpInputFileChangedOp()

2014-09-29 Thread Gopal V (JIRA)
Gopal V created HIVE-8294: - Summary: Hive-on-Tez is going into MapOperator::cleanUpInputFileChangedOp() Key: HIVE-8294 URL: https://issues.apache.org/jira/browse/HIVE-8294 Project: Hive Issue Type:

[jira] [Commented] (HIVE-8294) Hive-on-Tez is going into MapOperator::cleanUpInputFileChangedOp()

2014-09-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152248#comment-14152248 ] Gopal V commented on HIVE-8294: --- Even excluding the speed issue, that line produces approx

[jira] [Commented] (HIVE-8210) TezJobMonitor should print time spent in Application (RUNNING)

2014-09-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152250#comment-14152250 ] Gopal V commented on HIVE-8210: --- Yes, please - there is no way to debug this issue today of

[jira] [Commented] (HIVE-7156) Group-By operator stat-annotation only uses distinct approx to generate rollups

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149785#comment-14149785 ] Gopal V commented on HIVE-7156: --- LGTM - +1, tests pending. 36910400 = (4833087637230 /

[jira] [Updated] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8236: -- Priority: Blocker (was: Minor) VectorHashKeyWrapper allocates too many zero sized arrays

[jira] [Updated] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8236: -- Fix Version/s: 0.14.0 VectorHashKeyWrapper allocates too many zero sized arrays

[jira] [Updated] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8236: -- Labels: OOM (was: ) VectorHashKeyWrapper allocates too many zero sized arrays

[jira] [Created] (HIVE-8271) Jackson incompatibility between hadoop-2.4 and hive-14

2014-09-26 Thread Gopal V (JIRA)
Gopal V created HIVE-8271: - Summary: Jackson incompatibility between hadoop-2.4 and hive-14 Key: HIVE-8271 URL: https://issues.apache.org/jira/browse/HIVE-8271 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8271) Jackson incompatibility between hadoop-2.4 and hive-14

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8271: -- Attachment: HIVE-8271.1.patch Jackson incompatibility between hadoop-2.4 and hive-14

[jira] [Updated] (HIVE-8271) Jackson incompatibility between hadoop-2.4 and hive-14

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8271: -- Status: Patch Available (was: Open) Jackson incompatibility between hadoop-2.4 and hive-14

[jira] [Commented] (HIVE-8270) JDBC uber jar size is way too big - size should be reduced. It is also missing some classes required in secure setup

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150180#comment-14150180 ] Gopal V commented on HIVE-8270: --- Looks like minimizeJar is removing the classes accessed by

[jira] [Commented] (HIVE-8240) VectorColumnAssignFactory throws Incompatible Bytes vector column and primitive category VARCHAR

2014-09-26 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150298#comment-14150298 ] Gopal V commented on HIVE-8240: --- LGTM - +1, tests pending. VectorColumnAssignFactory throws

[jira] [Updated] (HIVE-8259) Queries in tez fail with exception

2014-09-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8259: -- Description: {code} ], TaskAttempt 3 failed, info=[Error: Failure while running

[jira] [Commented] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148581#comment-14148581 ] Gopal V commented on HIVE-8188: --- [~navis]: No worries, took a special benchmark run to catch

[jira] [Created] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-09-23 Thread Gopal V (JIRA)
Gopal V created HIVE-8236: - Summary: VectorHashKeyWrapper allocates too many zero sized arrays Key: HIVE-8236 URL: https://issues.apache.org/jira/browse/HIVE-8236 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-09-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8236: -- Attachment: HIVE-8236.1.patch VectorHashKeyWrapper allocates too many zero sized arrays

[jira] [Updated] (HIVE-8236) VectorHashKeyWrapper allocates too many zero sized arrays

2014-09-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8236: -- Status: Patch Available (was: Open) VectorHashKeyWrapper allocates too many zero sized arrays

[jira] [Commented] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143854#comment-14143854 ] Gopal V commented on HIVE-8156: --- Test failures are unrelated. Committed to trunk, thanks

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Resolution: Fixed Status: Resolved (was: Patch Available) Vectorized reducers need to avoid memory

[jira] [Updated] (HIVE-8156) Vectorized reducers need to avoid memory build-up during a single key

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8156: -- Release Note: HIVE-8156: Vectorized reducers need to avoid memory build-up during a single key (Gopal V reviewed

[jira] [Updated] (HIVE-8178) OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8178: -- Attachment: HIVE-8178.1.patch OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice

[jira] [Updated] (HIVE-8178) OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8178: -- Status: Patch Available (was: Open) OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo

[jira] [Commented] (HIVE-8078) ORC Delta encoding corrupts data when delta overflows long

2014-09-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143991#comment-14143991 ] Gopal V commented on HIVE-8078: --- LGTM - +1 on changes, pending tests. ORC Delta encoding

[jira] [Assigned] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-8188: - Assignee: Gopal V ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

[jira] [Updated] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8188: -- Labels: Performance (was: ) Status: Patch Available (was: Open) ExprNodeGenericFuncEvaluator::_evaluate()

[jira] [Updated] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8188: -- Attachment: HIVE-8188.1.patch ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight

[jira] [Updated] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8188: -- Attachment: HIVE-8188.2.patch ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight

[jira] [Created] (HIVE-8210) TezJobMonitor should print time spent in Application

2014-09-20 Thread Gopal V (JIRA)
Gopal V created HIVE-8210: - Summary: TezJobMonitor should print time spent in Application Key: HIVE-8210 URL: https://issues.apache.org/jira/browse/HIVE-8210 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8210) TezJobMonitor should print time spent in Application (RUNNING)

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8210: -- Summary: TezJobMonitor should print time spent in Application (RUNNING) (was: TezJobMonitor should print time

[jira] [Updated] (HIVE-8210) TezJobMonitor should print time spent in Application (RUNNING)

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8210: -- Attachment: HIVE-8210.1.patch TezJobMonitor should print time spent in Application (RUNNING)

[jira] [Updated] (HIVE-8210) TezJobMonitor should print time spent in Application (RUNNING)

2014-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8210: -- Status: Patch Available (was: Open) TezJobMonitor should print time spent in Application (RUNNING)

[jira] [Updated] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8188: -- Attachment: udf-deterministic.png ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight

[jira] [Created] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-19 Thread Gopal V (JIRA)
Gopal V created HIVE-8188: - Summary: ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop Key: HIVE-8188 URL: https://issues.apache.org/jira/browse/HIVE-8188 Project: Hive

[jira] [Commented] (HIVE-8188) ExprNodeGenericFuncEvaluator::_evaluate() loads class annotations in a tight loop

2014-09-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14141095#comment-14141095 ] Gopal V commented on HIVE-8188: --- [~prasanth_j]: that is pretty neat, speedup. But that's not

[jira] [Commented] (HIVE-8185) hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails verification for signatures in build

2014-09-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14141130#comment-14141130 ] Gopal V commented on HIVE-8185: --- +1 - LGTM. hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails

[jira] [Updated] (HIVE-8071) hive shell tries to write hive-exec.jar for each run

2014-09-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8071: -- Resolution: Fixed Fix Version/s: 0.14.0 Release Note: HIVE-8071: Speed up hive shell startup by

[jira] [Created] (HIVE-8178) OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice

2014-09-18 Thread Gopal V (JIRA)
Gopal V created HIVE-8178: - Summary: OrcNewInputFormat::getSplits() calls OrcInputFormat.generateSplitsInfo twice Key: HIVE-8178 URL: https://issues.apache.org/jira/browse/HIVE-8178 Project: Hive

[jira] [Created] (HIVE-8181) Upgrade JavaEWAH version to allow for unsorted bitset creation

2014-09-18 Thread Gopal V (JIRA)
Gopal V created HIVE-8181: - Summary: Upgrade JavaEWAH version to allow for unsorted bitset creation Key: HIVE-8181 URL: https://issues.apache.org/jira/browse/HIVE-8181 Project: Hive Issue Type: Bug

[jira] [Commented] (HIVE-8181) Upgrade JavaEWAH version to allow for unsorted bitset creation

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139317#comment-14139317 ] Gopal V commented on HIVE-8181: --- This is the JavaEWAH change-set, that fixes the limitation

[jira] [Created] (HIVE-8185) hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails verification for signatures in build

2014-09-18 Thread Gopal V (JIRA)
Gopal V created HIVE-8185: - Summary: hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails verification for signatures in build Key: HIVE-8185 URL: https://issues.apache.org/jira/browse/HIVE-8185 Project: Hive

[jira] [Commented] (HIVE-8185) hive-jdbc-0.14.0-SNAPSHOT-standalone.jar fails verification for signatures in build

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139703#comment-14139703 ] Gopal V commented on HIVE-8185: --- {code} 36829 Thu Sep 18 03:17:44 EDT 2014 META-INF/DUMMY.SF

[jira] [Updated] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8158: -- Fix Version/s: 0.14.0 Optimize writeValue/setValue in VectorExpressionWriterFactory (in

[jira] [Updated] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8158: -- Resolution: Fixed Release Note: HIVE-8158: Optimize writeValue/setValue in VectorExpressionWriterFactory

[jira] [Commented] (HIVE-7359) Stats based compute query replies fail to do simple column transforms

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14140021#comment-14140021 ] Gopal V commented on HIVE-7359: --- It fires a full-table scan instead of being optimized, but

[jira] [Commented] (HIVE-649) [UDF] now() for getting current time

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14140026#comment-14140026 ] Gopal V commented on HIVE-649: -- UDF NOW() can't be evaluated on the task, it has to be replaced

[jira] [Commented] (HIVE-649) [UDF] now() for getting current time

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14140034#comment-14140034 ] Gopal V commented on HIVE-649: -- Ah, I just hit the need for this and ran the patch - didn't

[jira] [Updated] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-18 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8038: -- Resolution: Fixed Release Note: HIVE-8038: Decouple ORC files split calculation logic from fixed-size

[jira] [Updated] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8158: -- Affects Version/s: 0.14.0 Optimize writeValue/setValue in VectorExpressionWriterFactory (in

[jira] [Updated] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8158: -- Component/s: Vectorization Optimize writeValue/setValue in VectorExpressionWriterFactory (in

[jira] [Commented] (HIVE-8158) Optimize writeValue/setValue in VectorExpressionWriterFactory (in VectorReduceSinkOperator codepath)

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138158#comment-14138158 ] Gopal V commented on HIVE-8158: --- LGTM - +1. Optimize writeValue/setValue in

[jira] [Commented] (HIVE-8071) hive shell tries to write hive-exec.jar for each run

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138325#comment-14138325 ] Gopal V commented on HIVE-8071: --- ?? That is my change-set up there. {code} private boolean

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Resolution: Fixed Release Note: Committed to trunk - thanks [~rpalamut]! Status: Resolved

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Fix Version/s: 0.14.0 Potential null pointer reference in WriterImpl#StreamFactory#createStream()

[jira] [Commented] (HIVE-8137) Empty ORC file handling

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135768#comment-14135768 ] Gopal V commented on HIVE-8137: --- The right approach is skip generating splits for such files.

[jira] [Commented] (HIVE-8137) Empty ORC file handling

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135790#comment-14135790 ] Gopal V commented on HIVE-8137: --- Hive's CombineInputFormat has pending changes to fix this -

[jira] [Updated] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8038: -- Attachment: HIVE-8038.3.patch +1 - Patch looks good. For commit - .3.patch, removed a white space change a

[jira] [Assigned] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-8090: - Assignee: Gopal V Potential null pointer reference in WriterImpl#StreamFactory#createStream()

[jira] [Updated] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8090: -- Component/s: File Formats Potential null pointer reference in WriterImpl#StreamFactory#createStream()

[jira] [Commented] (HIVE-8090) Potential null pointer reference in WriterImpl#StreamFactory#createStream()

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135847#comment-14135847 ] Gopal V commented on HIVE-8090: --- Test failures look unrelated - +1. Assigned to myself till

[jira] [Commented] (HIVE-8038) Decouple ORC files split calculation logic from Filesystem's get file location implementation

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135857#comment-14135857 ] Gopal V commented on HIVE-8038: --- No, there is a 24 hour waiting period after the +1. I will

[jira] [Updated] (HIVE-8071) hive shell tries to write hive-exec.jar for each run

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8071: -- Attachment: HIVE-8071.2.patch Rebasing patch to trunk using the local helper function instead of

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Component/s: Vectorization Vectorized Tez count(*) returns NULL instead of 0 when result is empty

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Component/s: Tez Vectorized Tez count(*) returns NULL instead of 0 when result is empty

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Labels: v (was: ) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Labels: (was: v) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

[jira] [Updated] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-8092: -- Affects Version/s: 0.14.0 Vectorized Tez count(*) returns NULL instead of 0 when result is empty

[jira] [Commented] (HIVE-8092) Vectorized Tez count(*) returns NULL instead of 0 when result is empty

2014-09-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136187#comment-14136187 ] Gopal V commented on HIVE-8092: --- LGTM - +1 Vectorized Tez count(*) returns NULL instead of

<    3   4   5   6   7   8   9   10   11   12   >