[jira] [Updated] (HIVE-4083) PTF ColumnPruner doesn't account for Partition Order expressions
[ https://issues.apache.org/jira/browse/HIVE-4083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4083: -- Attachment: HIVE-4083.D9069.1.patch pkalmegh requested code review of HIVE-4083 [jira] PTF ColumnPruner doesn't account for Partition Order expressions. Reviewers: JIRA Add columns from partition, order and having expressions of WindowingTableFunctionDef while pruning columns for PTFOperator for windowing TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D9069 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/optimizer/ColumnPrunerProcFactory.java ql/src/test/queries/clientpositive/windowing_columnPruning.q ql/src/test/results/clientpositive/windowing_columnPruning.q.out MANAGE HERALD RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/21981/ To: JIRA, pkalmegh PTF ColumnPruner doesn't account for Partition Order expressions -- Key: HIVE-4083 URL: https://issues.apache.org/jira/browse/HIVE-4083 Project: Hive Issue Type: Bug Components: PTF-Windowing Reporter: Harish Butani Assignee: Prajakta Kalmegh Attachments: HIVE-4083.D9069.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-4085) Incorrectly pruning columns for PTFOperator
[
https://issues.apache.org/jira/browse/HIVE-4085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prajakta Kalmegh resolved HIVE-4085.
Resolution: Duplicate
Same error as HIVE-4083. Uploaded a patch in HIVE-4083.
Incorrectly pruning columns for PTFOperator
---
Key: HIVE-4085
URL: https://issues.apache.org/jira/browse/HIVE-4085
Project: Hive
Issue Type: Bug
Components: PTF-Windowing
Reporter: Ashutosh Chauhan
Following simple query used to work before HIVE-4035
{code}
select s, sum(b) over (distribute by i sort by si rows between unbounded
preceding and current row) from over100k;
{code}
but now it fails.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21 #309
See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/309/ -- [...truncated 5582 lines...] [ivy:resolve] . (1527kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] org.apache.hadoop#hadoop-test;0.20.2!hadoop-test.jar (197ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/commons-cli/commons-cli/1.2/commons-cli-1.2.jar ... [ivy:resolve] .. (40kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] commons-cli#commons-cli;1.2!commons-cli.jar (100ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/xmlenc/xmlenc/0.52/xmlenc-0.52.jar ... [ivy:resolve] .. (14kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] xmlenc#xmlenc;0.52!xmlenc.jar (110ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/commons-httpclient/commons-httpclient/3.0.1/commons-httpclient-3.0.1.jar ... [ivy:resolve] . (273kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] commons-httpclient#commons-httpclient;3.0.1!commons-httpclient.jar (110ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/commons-codec/commons-codec/1.3/commons-codec-1.3.jar ... [ivy:resolve] .. (45kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] commons-codec#commons-codec;1.3!commons-codec.jar (250ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar ... [ivy:resolve] . (176kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] commons-net#commons-net;1.4.1!commons-net.jar (103ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jetty/6.1.14/jetty-6.1.14.jar ... [ivy:resolve] . (504kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jetty;6.1.14!jetty.jar (326ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jetty-util/6.1.14/jetty-util-6.1.14.jar ... [ivy:resolve] (159kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jetty-util;6.1.14!jetty-util.jar (104ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/tomcat/jasper-runtime/5.5.12/jasper-runtime-5.5.12.jar ... [ivy:resolve] ... (74kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] tomcat#jasper-runtime;5.5.12!jasper-runtime.jar (101ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/tomcat/jasper-compiler/5.5.12/jasper-compiler-5.5.12.jar ... [ivy:resolve] ... (395kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] tomcat#jasper-compiler;5.5.12!jasper-compiler.jar (110ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar ... [ivy:resolve] ... (131kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jsp-api-2.1;6.1.14!jsp-api-2.1.jar (102ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar ... [ivy:resolve] (1000kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jsp-2.1;6.1.14!jsp-2.1.jar (218ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/commons-el/commons-el/1.0/commons-el-1.0.jar ... [ivy:resolve] (109kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] commons-el#commons-el;1.0!commons-el.jar (102ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar ... [ivy:resolve] .. (368kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] net.java.dev.jets3t#jets3t;0.7.1!jets3t.jar (107ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar ... [ivy:resolve] ... (129kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#servlet-api-2.5;6.1.14!servlet-api-2.5.jar (103ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar ... [ivy:resolve] .. (11kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] net.sf.kosmosfs#kfs;0.3!kfs.jar (99ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/junit/junit/4.5/junit-4.5.jar ... [ivy:resolve] ... (194kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] junit#junit;4.5!junit.jar (104ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar ... [ivy:resolve] .. (690kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] hsqldb#hsqldb;1.8.0.10!hsqldb.jar (133ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/oro/oro/2.0.8/oro-2.0.8.jar ... [ivy:resolve] ... (63kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] oro#oro;2.0.8!oro.jar (100ms) [ivy:resolve] downloading
Build failed in Jenkins: Hive-0.10.0-SNAPSHOT-h0.20.1 #82
See https://builds.apache.org/job/Hive-0.10.0-SNAPSHOT-h0.20.1/82/ -- [...truncated 6177 lines...] [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/service/test/resources [copy] Warning: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/service/src/test/resources does not exist. init: [echo] Project: service create-dirs: [echo] Project: cli [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/cli [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/cli/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/cli/test [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/cli/test/src [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/cli/test/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/cli/test/resources [copy] Warning: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/cli/src/test/resources does not exist. init: [echo] Project: cli create-dirs: [echo] Project: jdbc [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/jdbc [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/jdbc/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/jdbc/test [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/jdbc/test/src [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/jdbc/test/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/jdbc/test/resources [copy] Warning: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/jdbc/src/test/resources does not exist. init: [echo] Project: jdbc create-dirs: [echo] Project: hwi [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hwi [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hwi/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hwi/test [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hwi/test/src [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hwi/test/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hwi/test/resources [copy] Warning: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/hwi/src/test/resources does not exist. init: [echo] Project: hwi create-dirs: [echo] Project: hbase-handler [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hbase-handler [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hbase-handler/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hbase-handler/test [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hbase-handler/test/src [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hbase-handler/test/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/hbase-handler/test/resources [copy] Warning: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/hbase-handler/src/test/resources does not exist. init: [echo] Project: hbase-handler create-dirs: [echo] Project: pdk [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/pdk [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/pdk/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/pdk/test [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/pdk/test/src [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/pdk/test/classes [mkdir] Created dir: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/build/pdk/test/resources [copy] Warning: /x1/jenkins/jenkins-slave/workspace/Hive-0.10.0-SNAPSHOT-h0.20.1/hive/pdk/src/test/resources does not exist. init: [echo] Project: pdk create-dirs:
Hive-trunk-h0.21 - Build # 1997 - Still Failing
Changes for Build #1995 Changes for Build #1996 Changes for Build #1997 No tests ran. The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1997) Status: Still Failing Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1997/ to view the results.
[jira] [Updated] (HIVE-4104) Hive localtask does not buffer disk-writes or reads
[
https://issues.apache.org/jira/browse/HIVE-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-4104:
---
Resolution: Fixed
Fix Version/s: 0.11.0
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks, Gopal!
Hive localtask does not buffer disk-writes or reads
---
Key: HIVE-4104
URL: https://issues.apache.org/jira/browse/HIVE-4104
Project: Hive
Issue Type: Bug
Reporter: Gopal V
Assignee: Gopal V
Priority: Minor
Fix For: 0.11.0
Attachments: HIVE-4104.patch
Hive's HashMapWrapper does not use any buffering in its File I/O, but
operates sequentially for writes reads.
The strace logs show clearly that
{code}
9495 write(222, x, 1)= 1
9495 write(222, sq\0~\0\5, 6)= 6
9495 write(222, w\25, 2) = 2
9495 write(222, \0\0\0\1\0\0\0\1\0\0\0\2\0\0\0\5\3\1M\1S, 21) = 21
9495 write(222, x, 1)= 1
9495 write(222, sq\0~\0\2, 6)= 6
9495 write(222, w\t, 2) = 2
9495 write(222, \0\0\0\5\1\215\r\325v, 9) = 9
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4020) Swap applying order of CP and PPD
[
https://issues.apache.org/jira/browse/HIVE-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-4020:
--
Attachment: HIVE-4020.D8571.2.patch
navis updated the revision HIVE-4020 [jira] Swap applying order of CP and PPD.
Updated diff result
Reviewers: JIRA
REVISION DETAIL
https://reviews.facebook.net/D8571
CHANGE SINCE LAST DIFF
https://reviews.facebook.net/D8571?vs=27711id=29127#toc
AFFECTED FILES
ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java
ql/src/test/results/clientpositive/auto_join19.q.out
ql/src/test/results/clientpositive/auto_join9.q.out
ql/src/test/results/clientpositive/bucketmapjoin1.q.out
ql/src/test/results/clientpositive/bucketmapjoin_negative.q.out
ql/src/test/results/clientpositive/filter_join_breaktask.q.out
ql/src/test/results/clientpositive/index_auto_mult_tables.q.out
ql/src/test/results/clientpositive/index_auto_mult_tables_compact.q.out
ql/src/test/results/clientpositive/input39_hadoop20.q.out
ql/src/test/results/clientpositive/join38.q.out
ql/src/test/results/clientpositive/join9.q.out
ql/src/test/results/clientpositive/join_map_ppr.q.out
ql/src/test/results/clientpositive/lateral_view_ppd.q.out
ql/src/test/results/clientpositive/louter_join_ppr.q.out
ql/src/test/results/clientpositive/ppd_repeated_alias.q.out
ql/src/test/results/clientpositive/router_join_ppr.q.out
ql/src/test/results/clientpositive/smb_mapjoin9.q.out
ql/src/test/results/clientpositive/sort_merge_join_desc_1.q.out
ql/src/test/results/clientpositive/sort_merge_join_desc_2.q.out
ql/src/test/results/clientpositive/sort_merge_join_desc_3.q.out
ql/src/test/results/clientpositive/sort_merge_join_desc_4.q.out
ql/src/test/results/clientpositive/stats11.q.out
ql/src/test/results/clientpositive/union26.q.out
ql/src/test/results/compiler/plan/case_sensitivity.q.xml
ql/src/test/results/compiler/plan/cast1.q.xml
ql/src/test/results/compiler/plan/input1.q.xml
ql/src/test/results/compiler/plan/input6.q.xml
ql/src/test/results/compiler/plan/input9.q.xml
ql/src/test/results/compiler/plan/input_part1.q.xml
ql/src/test/results/compiler/plan/input_testxpath2.q.xml
ql/src/test/results/compiler/plan/join4.q.xml
ql/src/test/results/compiler/plan/join5.q.xml
ql/src/test/results/compiler/plan/join6.q.xml
ql/src/test/results/compiler/plan/join7.q.xml
ql/src/test/results/compiler/plan/join8.q.xml
ql/src/test/results/compiler/plan/sample7.q.xml
ql/src/test/results/compiler/plan/subq.q.xml
ql/src/test/results/compiler/plan/udf1.q.xml
ql/src/test/results/compiler/plan/union.q.xml
To: JIRA, navis
Swap applying order of CP and PPD
-
Key: HIVE-4020
URL: https://issues.apache.org/jira/browse/HIVE-4020
Project: Hive
Issue Type: Improvement
Components: Query Processor
Reporter: Navis
Assignee: Navis
Priority: Minor
Attachments: HIVE-4020.D8571.1.patch, HIVE-4020.D8571.2.patch
Doing Hive-2340, I've found CP removed some column mapping needed for
backtracking expression desc. By swapping order of CP and PPD, the problem
was solved.
After that I've realized that CP on earlier stage is possible after PPD is
applied cause some columns on filter predicate are not selected and can be
removed right after the new pushed-down filter. For example,
(bucketmapjoin1.q)
noformat
select /*+mapjoin(b)*/ a.key, a.value, b.value
from srcbucket_mapjoin_part a join srcbucket_mapjoin_part_2 b
on a.key=b.key where b.ds=2008-04-08
noformat
plan for hashtable sink operator is changed to
noformat
HashTable Sink Operator
condition expressions:
0 {key} {value}
1 {value}
noformat
which was
noformat
HashTable Sink Operator
condition expressions:
0 {key} {value}
1 {value} {ds}
noformat
HIVE-2340 seemed need more time for commit, so booked as an another issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4068) Size of aggregation buffer which uses non-primitive type is not estimated correctly
[ https://issues.apache.org/jira/browse/HIVE-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4068: -- Attachment: HIVE-4068.D8859.4.patch navis updated the revision HIVE-4068 [jira] Size of aggregation buffer which uses non-primitive type is not estimated correctly. Addressed comment Reviewers: JIRA REVISION DETAIL https://reviews.facebook.net/D8859 CHANGE SINCE LAST DIFF https://reviews.facebook.net/D8859?vs=28593id=29133#toc AFFECTED FILES builtins/src/org/apache/hive/builtins/UDAFUnionMap.java pdk/scripts/build-plugin.xml ql/src/java/org/apache/hadoop/hive/ql/exec/GroupByOperator.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFAverage.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFBridge.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFCollectSet.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFComputeStats.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFContextNGrams.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFCorrelation.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFCount.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFCovariance.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFEWAHBitmap.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFEvaluator.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFHistogramNumeric.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFMax.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFMin.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFPercentileApprox.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFSum.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFVariance.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFnGrams.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/NumericHistogram.java ql/src/java/org/apache/hadoop/hive/ql/util/JavaDataModel.java To: JIRA, navis Cc: njain Size of aggregation buffer which uses non-primitive type is not estimated correctly --- Key: HIVE-4068 URL: https://issues.apache.org/jira/browse/HIVE-4068 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Navis Assignee: Navis Priority: Minor Attachments: HIVE-4068.D8859.1.patch, HIVE-4068.D8859.2.patch, HIVE-4068.D8859.3.patch, HIVE-4068.D8859.4.patch Currently, hive assumes an aggregation buffer which holds a map is occupying just 256 byte (fixed). If it's bigger than that in real, OutOfMemoryError can be thrown (especially for 1k buffer). workaround : set hive.map.aggr.hash.percentmemory=smaller value than default(0.5) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4068) Size of aggregation buffer which uses non-primitive type is not estimated correctly
[ https://issues.apache.org/jira/browse/HIVE-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-4068: Status: Patch Available (was: Open) Size of aggregation buffer which uses non-primitive type is not estimated correctly --- Key: HIVE-4068 URL: https://issues.apache.org/jira/browse/HIVE-4068 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Navis Assignee: Navis Priority: Minor Attachments: HIVE-4068.D8859.1.patch, HIVE-4068.D8859.2.patch, HIVE-4068.D8859.3.patch, HIVE-4068.D8859.4.patch Currently, hive assumes an aggregation buffer which holds a map is occupying just 256 byte (fixed). If it's bigger than that in real, OutOfMemoryError can be thrown (especially for 1k buffer). workaround : set hive.map.aggr.hash.percentmemory=smaller value than default(0.5) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4083) PTF ColumnPruner doesn't account for Partition Order expressions
[ https://issues.apache.org/jira/browse/HIVE-4083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591934#comment-13591934 ] Phabricator commented on HIVE-4083: --- ashutoshc has accepted the revision HIVE-4083 [jira] PTF ColumnPruner doesn't account for Partition Order expressions. +1 REVISION DETAIL https://reviews.facebook.net/D9069 BRANCH HIVE-4083-dev-branch ARCANIST PROJECT hive To: JIRA, ashutoshc, pkalmegh PTF ColumnPruner doesn't account for Partition Order expressions -- Key: HIVE-4083 URL: https://issues.apache.org/jira/browse/HIVE-4083 Project: Hive Issue Type: Bug Components: PTF-Windowing Reporter: Harish Butani Assignee: Prajakta Kalmegh Attachments: HIVE-4083.D9069.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-4083) PTF ColumnPruner doesn't account for Partition Order expressions
[ https://issues.apache.org/jira/browse/HIVE-4083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan resolved HIVE-4083. Resolution: Fixed Committed to branch. Thanks, Prajakta! PTF ColumnPruner doesn't account for Partition Order expressions -- Key: HIVE-4083 URL: https://issues.apache.org/jira/browse/HIVE-4083 Project: Hive Issue Type: Bug Components: PTF-Windowing Reporter: Harish Butani Assignee: Prajakta Kalmegh Attachments: HIVE-4083.D9069.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4111) Default value in lag is not handled correctly
Ashutosh Chauhan created HIVE-4111: -- Summary: Default value in lag is not handled correctly Key: HIVE-4111 URL: https://issues.apache.org/jira/browse/HIVE-4111 Project: Hive Issue Type: Bug Components: PTF-Windowing Reporter: Ashutosh Chauhan select s, lag(s, 3, 'fred') over (partition by f order by b) from over100k; results in runtime exception. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4111) Default value in lag is not handled correctly
[
https://issues.apache.org/jira/browse/HIVE-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591936#comment-13591936
]
Ashutosh Chauhan commented on HIVE-4111:
Stack trace from reducer:
{noformat}
Caused by: java.lang.ArrayIndexOutOfBoundsException: -1
at java.util.ArrayList.remove(ArrayList.java:390)
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDAFLag$LagBuffer.terminate(GenericUDAFLag.java:86)
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDAFLeadLag$GenericUDAFLeadLagEvaluator.terminate(GenericUDAFLeadLag.java:175)
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.evaluate(GenericUDAFEvaluator.java:177)
at
org.apache.hadoop.hive.ql.udf.ptf.WindowingTableFunction.execute(WindowingTableFunction.java:102)
at
org.apache.hadoop.hive.ql.udf.ptf.WindowingTableFunction.execute(WindowingTableFunction.java:62)
at
org.apache.hadoop.hive.ql.exec.PTFOperator.executeChain(PTFOperator.java:282)
at
org.apache.hadoop.hive.ql.exec.PTFOperator.processInputPartition(PTFOperator.java:205)
at
org.apache.hadoop.hive.ql.exec.PTFOperator.processOp(PTFOperator.java:139)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:529)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:857)
at
org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(ExtractOperator.java:45)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:529)
at
org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:256)
{noformat}
Default value in lag is not handled correctly
-
Key: HIVE-4111
URL: https://issues.apache.org/jira/browse/HIVE-4111
Project: Hive
Issue Type: Bug
Components: PTF-Windowing
Reporter: Ashutosh Chauhan
select s, lag(s, 3, 'fred') over (partition by f order by b) from over100k;
results in runtime exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4112) Window range specification should be more flexible
Ashutosh Chauhan created HIVE-4112: -- Summary: Window range specification should be more flexible Key: HIVE-4112 URL: https://issues.apache.org/jira/browse/HIVE-4112 Project: Hive Issue Type: Bug Components: PTF-Windowing Reporter: Ashutosh Chauhan select s, avg(f) over (partition by dec order by d rows 5 preceding) from over100k; is a legal query which is currently rejected by Parser. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4112) Window range specification should be more flexible
[ https://issues.apache.org/jira/browse/HIVE-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591938#comment-13591938 ] Ashutosh Chauhan commented on HIVE-4112: Fix of HIVE-4034 needs to be extended to handle above case as well. Window range specification should be more flexible -- Key: HIVE-4112 URL: https://issues.apache.org/jira/browse/HIVE-4112 Project: Hive Issue Type: Bug Components: PTF-Windowing Reporter: Ashutosh Chauhan select s, avg(f) over (partition by dec order by d rows 5 preceding) from over100k; is a legal query which is currently rejected by Parser. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4104) Hive localtask does not buffer disk-writes or reads
[
https://issues.apache.org/jira/browse/HIVE-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591946#comment-13591946
]
Hudson commented on HIVE-4104:
--
Integrated in Hive-trunk-h0.21 #1998 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1998/])
HIVE-4104 : Hive localtask does not buffer disk-writes or reads (Gopal V
via Ashutosh Chauhan) (Revision 1452104)
Result = SUCCESS
hashutosh :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1452104
Files :
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/HashMapWrapper.java
Hive localtask does not buffer disk-writes or reads
---
Key: HIVE-4104
URL: https://issues.apache.org/jira/browse/HIVE-4104
Project: Hive
Issue Type: Bug
Reporter: Gopal V
Assignee: Gopal V
Priority: Minor
Fix For: 0.11.0
Attachments: HIVE-4104.patch
Hive's HashMapWrapper does not use any buffering in its File I/O, but
operates sequentially for writes reads.
The strace logs show clearly that
{code}
9495 write(222, x, 1)= 1
9495 write(222, sq\0~\0\5, 6)= 6
9495 write(222, w\25, 2) = 2
9495 write(222, \0\0\0\1\0\0\0\1\0\0\0\2\0\0\0\5\3\1M\1S, 21) = 21
9495 write(222, x, 1)= 1
9495 write(222, sq\0~\0\2, 6)= 6
9495 write(222, w\t, 2) = 2
9495 write(222, \0\0\0\5\1\215\r\325v, 9) = 9
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1998 - Fixed
Changes for Build #1995 Changes for Build #1996 Changes for Build #1997 Changes for Build #1998 [hashutosh] HIVE-4104 : Hive localtask does not buffer disk-writes or reads (Gopal V via Ashutosh Chauhan) All tests passed The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1998) Status: Fixed Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1998/ to view the results.
[jira] [Commented] (HIVE-4082) Break up ptf tests in PTF, Windowing and Lead/Lag tests
[ https://issues.apache.org/jira/browse/HIVE-4082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591947#comment-13591947 ] Phabricator commented on HIVE-4082: --- ashutoshc has accepted the revision HIVE-4082 [jira] Break up ptf tests in PTF, Windowing and Lead/Lag tests. +1 REVISION DETAIL https://reviews.facebook.net/D9033 BRANCH HIVE-4082-dev-branch ARCANIST PROJECT hive To: JIRA, ashutoshc, pkalmegh Break up ptf tests in PTF, Windowing and Lead/Lag tests --- Key: HIVE-4082 URL: https://issues.apache.org/jira/browse/HIVE-4082 Project: Hive Issue Type: Bug Components: PTF-Windowing Reporter: Harish Butani Assignee: Prajakta Kalmegh Attachments: HIVE-4082.D9033.1.patch, HIVE-4082.D9033.2.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-4082) Break up ptf tests in PTF, Windowing and Lead/Lag tests
[ https://issues.apache.org/jira/browse/HIVE-4082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan resolved HIVE-4082. Resolution: Fixed Committed to branch. Thanks, Prajakta! Break up ptf tests in PTF, Windowing and Lead/Lag tests --- Key: HIVE-4082 URL: https://issues.apache.org/jira/browse/HIVE-4082 Project: Hive Issue Type: Bug Components: PTF-Windowing Reporter: Harish Butani Assignee: Prajakta Kalmegh Attachments: HIVE-4082.D9033.1.patch, HIVE-4082.D9033.2.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3896) Hive Website docs have not be updated
[ https://issues.apache.org/jira/browse/HIVE-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591975#comment-13591975 ] Lefty Leverenz commented on HIVE-3896: -- See [https://issues.apache.org/jira/browse/HIVE-4074]: Doc update for .8, .9, and .10. Hive Website docs have not be updated - Key: HIVE-3896 URL: https://issues.apache.org/jira/browse/HIVE-3896 Project: Hive Issue Type: New Feature Reporter: Brock Noland Priority: Minor Hive documentation links on the website do not work, for example: http://hive.apache.org/docs/r0.9.0/ -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-3655) Use ChainMapper and ChainReducer for queries having [Map+][RMap*] pattern
[ https://issues.apache.org/jira/browse/HIVE-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu resolved HIVE-3655. --- Resolution: Won't Fix Use ChainMapper and ChainReducer for queries having [Map+][RMap*] pattern - Key: HIVE-3655 URL: https://issues.apache.org/jira/browse/HIVE-3655 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Amareshwari Sriramadasu While breaking the query plan into multiple map reduce tasks, Hive should consider the pattern [Map+][ReduceMap*] and generate single map reduce job for such patterns using ChainMapper and ChainReducer -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2340) optimize orderby followed by a groupby
[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591995#comment-13591995 ] Gunther Hagleitner commented on HIVE-2340: -- [~navis]: I've tried the latest patch (.13) and it doesn't apply cleanly anymore. I rebased it, but after doing so I got an NPE from auto_join19.q. Something must have changed in the meantime. I was however able to get the previous version of the patch to apply and work with just a minor change. Tests pass for me on that one. I'll upload, in case you want to take a look. Feel free to ignore. optimize orderby followed by a groupby -- Key: HIVE-2340 URL: https://issues.apache.org/jira/browse/HIVE-2340 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Navis Assignee: Navis Priority: Minor Labels: perfomance Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.1.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.2.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.3.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.4.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.5.patch, HIVE-2340.12.patch, HIVE-2340.13.patch, HIVE-2340.14.patch, HIVE-2340.1.patch.txt, HIVE-2340.D1209.10.patch, HIVE-2340.D1209.11.patch, HIVE-2340.D1209.12.patch, HIVE-2340.D1209.13.patch, HIVE-2340.D1209.6.patch, HIVE-2340.D1209.7.patch, HIVE-2340.D1209.8.patch, HIVE-2340.D1209.9.patch, testclidriver.txt Before implementing optimizer for JOIN-GBY, try to implement RS-GBY optimizer(cluster-by following group-by). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2340) optimize orderby followed by a groupby
[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-2340: - Attachment: HIVE-2340.14.patch As mentioned. Based on .12. This one applys and works for me. optimize orderby followed by a groupby -- Key: HIVE-2340 URL: https://issues.apache.org/jira/browse/HIVE-2340 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Navis Assignee: Navis Priority: Minor Labels: perfomance Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.1.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.2.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.3.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.4.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.5.patch, HIVE-2340.12.patch, HIVE-2340.13.patch, HIVE-2340.14.patch, HIVE-2340.1.patch.txt, HIVE-2340.D1209.10.patch, HIVE-2340.D1209.11.patch, HIVE-2340.D1209.12.patch, HIVE-2340.D1209.13.patch, HIVE-2340.D1209.6.patch, HIVE-2340.D1209.7.patch, HIVE-2340.D1209.8.patch, HIVE-2340.D1209.9.patch, testclidriver.txt Before implementing optimizer for JOIN-GBY, try to implement RS-GBY optimizer(cluster-by following group-by). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2340) optimize orderby followed by a groupby
[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13591997#comment-13591997 ] Gunther Hagleitner commented on HIVE-2340: -- HIVE-2340.14.patch that is. optimize orderby followed by a groupby -- Key: HIVE-2340 URL: https://issues.apache.org/jira/browse/HIVE-2340 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Navis Assignee: Navis Priority: Minor Labels: perfomance Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.1.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.2.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.3.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.4.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.5.patch, HIVE-2340.12.patch, HIVE-2340.13.patch, HIVE-2340.14.patch, HIVE-2340.1.patch.txt, HIVE-2340.D1209.10.patch, HIVE-2340.D1209.11.patch, HIVE-2340.D1209.12.patch, HIVE-2340.D1209.13.patch, HIVE-2340.D1209.6.patch, HIVE-2340.D1209.7.patch, HIVE-2340.D1209.8.patch, HIVE-2340.D1209.9.patch, testclidriver.txt Before implementing optimizer for JOIN-GBY, try to implement RS-GBY optimizer(cluster-by following group-by). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3490) Implement * or a.* for arguments to UDFs
[ https://issues.apache.org/jira/browse/HIVE-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3490: - Resolution: Fixed Fix Version/s: 0.11.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Navis Implement * or a.* for arguments to UDFs Key: HIVE-3490 URL: https://issues.apache.org/jira/browse/HIVE-3490 Project: Hive Issue Type: Bug Components: Query Processor, UDF Reporter: Adam Kramer Assignee: Navis Fix For: 0.11.0 Attachments: HIVE-3490.D8889.1.patch, HIVE-3490.D8889.2.patch For a random UDF, we should be able to use * or a.* to refer to all of the columns in their natural order. This is not currently implemented. I'm reporting this as a bug because it is a manner in which Hive is inconsistent with the SQL spec, and because Hive claims to implement *. hive select all_non_null(a.*) from table a where a.ds='2012-09-01'; FAILED: ParseException line 1:25 mismatched input '*' expecting Identifier near '.' in expression specification -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3490) Implement * or a.* for arguments to UDFs
[ https://issues.apache.org/jira/browse/HIVE-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13592042#comment-13592042 ] Navis commented on HIVE-3490: - I've forgot to comment that this is only for UDF and UDTF. UDAF is not supported yet. Implement * or a.* for arguments to UDFs Key: HIVE-3490 URL: https://issues.apache.org/jira/browse/HIVE-3490 Project: Hive Issue Type: Bug Components: Query Processor, UDF Reporter: Adam Kramer Assignee: Navis Fix For: 0.11.0 Attachments: HIVE-3490.D8889.1.patch, HIVE-3490.D8889.2.patch For a random UDF, we should be able to use * or a.* to refer to all of the columns in their natural order. This is not currently implemented. I'm reporting this as a bug because it is a manner in which Hive is inconsistent with the SQL spec, and because Hive claims to implement *. hive select all_non_null(a.*) from table a where a.ds='2012-09-01'; FAILED: ParseException line 1:25 mismatched input '*' expecting Identifier near '.' in expression specification -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2340) optimize orderby followed by a groupby
[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13592046#comment-13592046 ] Navis commented on HIVE-2340: - [~hagleitn]: It seemed affected by HIVE-948, which is recently committed. Thank for your help. I'll check that. optimize orderby followed by a groupby -- Key: HIVE-2340 URL: https://issues.apache.org/jira/browse/HIVE-2340 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Navis Assignee: Navis Priority: Minor Labels: perfomance Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.1.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.2.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.3.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.4.patch, ASF.LICENSE.NOT.GRANTED--HIVE-2340.D1209.5.patch, HIVE-2340.12.patch, HIVE-2340.13.patch, HIVE-2340.14.patch, HIVE-2340.1.patch.txt, HIVE-2340.D1209.10.patch, HIVE-2340.D1209.11.patch, HIVE-2340.D1209.12.patch, HIVE-2340.D1209.13.patch, HIVE-2340.D1209.6.patch, HIVE-2340.D1209.7.patch, HIVE-2340.D1209.8.patch, HIVE-2340.D1209.9.patch, testclidriver.txt Before implementing optimizer for JOIN-GBY, try to implement RS-GBY optimizer(cluster-by following group-by). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
