[jira] [Created] (HIVE-2747) UNION ALL with subquery which selects NULL and performs group by fails
UNION ALL with subquery which selects NULL and performs group by fails -- Key: HIVE-2747 URL: https://issues.apache.org/jira/browse/HIVE-2747 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong Queries like the following from (select key, value, count(1) as count from src group by key, value union all select NULL as key, value, count(1) as count from src group by value) a select count(*); fail with the exception java.lang.NullPointerException at org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:60) at java.lang.String.valueOf(String.java:2826) at java.lang.StringBuilder.append(StringBuilder.java:115) at org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:427) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:98) ... 18 more This should at least provide a more informative error message if not work. It works without the group by. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2686) Test ppr_pushdown.q is failing on trunk
[
https://issues.apache.org/jira/browse/HIVE-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13192958#comment-13192958
]
Navis commented on HIVE-2686:
-
Before HIVE-2642, union in ppr_pushdown was executed by single map task. But
after that it is executed by two map task, making table ordering issue(A-B or
B-A). With multiple inputs, mini-MR and hadoop-MR make different results which
explains why executing same query in hive-cli makes accordant with
'ql/test/results' but ant test always fails.
And.. topOps/topSelOps in SemanticAnalyzer also make ordering issue for union.
It is not non-deterministic, but it is non-predictive. I think it should be
changed to LinkedHashMap (HashMap, currently).
Current patch (not using union) might be enough for resolving this issue. But
above problems should be resolved above all.
Test ppr_pushdown.q is failing on trunk
---
Key: HIVE-2686
URL: https://issues.apache.org/jira/browse/HIVE-2686
Project: Hive
Issue Type: Test
Components: Testing Infrastructure
Affects Versions: 0.9.0
Reporter: Ashutosh Chauhan
Assignee: Navis
Priority: Minor
Fix For: 0.9.0
Attachments: HIVE-2686.D1215.1.patch
{noformat}
$ ant test -Dtestcase=TestCliDriver -Dqfile=ppr_pushdown.q
[junit] See build/ql/tmp/hive.log, or try ant test ...
-Dtest.silent=false to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown(TestCliDriver.java:129)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
[junit] 178d177
[junit] 12341234
[junit] 179a179
[junit] 12341234
[junit] 196d195
[junit] 12241224
[junit] 197a197
[junit] 12241224
[junit] 214d213
[junit] Exception: Client execution results failed with error code = 1
[junit] See build/ql/tmp/hive.log, or try ant test ...
-Dtest.silent=false to get more logs.
[junit] 12141214
[junit] 215a215
[junit] 12141214
[junit] 232d231
[junit] 12.412.4
[junit] 233a233
[junit] 12.412.4
[junit] 250d249
[junit] 12+412+4
[junit] 251a251
[junit] 12+412+4
[junit] 268d267
[junit] 12:412:4
[junit] 269a269
[junit] 12:412:4
[junit] 286d285
[junit] 12%412%4
[junit] 287a287
[junit] 12%412%4
[junit] 304d303
[junit] 12*412*4
[junit] 305a305
[junit] 12*412*4
[junit] Cleaning up TestCliDriver
[junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 137.556 sec
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2738) NPE in ExprNodeGenericFuncEvaluator
[
https://issues.apache.org/jira/browse/HIVE-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicolas Lalevée updated HIVE-2738:
--
Attachment: 750c8966-6402-465a-b011-903469fe56da.xml
For what it's worth, here is the plan of the second hadoop job which is been
executed. The two generic udf seems to be declared on ExprNodeGenericFuncDesc
(l. 490-538)
NPE in ExprNodeGenericFuncEvaluator
---
Key: HIVE-2738
URL: https://issues.apache.org/jira/browse/HIVE-2738
Project: Hive
Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Nicolas Lalevée
Attachments: 750c8966-6402-465a-b011-903469fe56da.xml,
MapMaxUDF.java, MapToJsonUDF.java, hive_job_logs.txt
Here is the query:
bq. {{SELECT t.lid, '2011-12-12',
s_map2json(s_maxmap(UNION_MAP(t.categoryCount), 100)) FROM ( SELECT theme_lid
AS theme_lid, MAP(s_host(referer), COUNT( * )) AS categoryCount FROM
PageViewEvent WHERE day = '20130104' AND day = '20130112' AND date_ =
'2012-01-04' AND date_ '2012-01-13' AND lid IS NOT NULL GROUP BY lid,
s_host(referer) ) t GROUP BY t.lid}}
Removing the call s_map2json make it work but not by removing s_maxmap, but I
don't understand what could be wrong with the implementation of my udf. And I
don't know how to debug remote hadoop jobs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1218 - Still Failing
Changes for Build #1184 [namit] HIVE-2690 a bug in 'alter table concatenate' that causes filenames getting double url encoded (He Yongqiang via namit) Changes for Build #1185 Changes for Build #1186 Changes for Build #1187 Changes for Build #1188 Changes for Build #1189 Changes for Build #1190 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1191 [amareshwari] HIVE-2629. Reverting previous commit Changes for Build #1192 [heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars (Kevin Wilfong via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2706 The issue was that the current thread's classloader and the classloader in the conf differed due to the prehook updating only the current thread's classloader with new jars. Now, it updates both classloaders, fixing the issue. When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error. Test Plan: Verified it fixed the stack overflow error. Reviewers: JIRA, heyongqiang, njain Reviewed By: heyongqiang CC: heyongqiang Differential Revision: https://reviews.facebook.net/D1167 Changes for Build #1193 [hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it shouldn't (jghoman via hashutosh) Changes for Build #1194 Changes for Build #1195 [hashutosh] HIVE-2589: Newly created partition should inherit properties from table (Ashutosh Chauhan) [hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan) Changes for Build #1196 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1197 Changes for Build #1198 [namit] HIVE-2504 Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Chinna Rao Lalam via namit) [namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit) Changes for Build #1199 Changes for Build #1200 Changes for Build #1201 Changes for Build #1202 Changes for Build #1203 Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 Changes for Build #1210 [namit] HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) Changes for Build #1211 [cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao Luo via cws) [cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws) Changes for Build #1212 [hashutosh] HIVE-2589 : Newly created partition should inherit properties from table (Ashutosh Chauhan) Changes for Build #1213 Changes for Build #1214 Changes for Build #1215 Changes for Build #1216 [cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws) Changes for Build #1217 Changes for Build #1218 1 tests failed. REGRESSION: org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore Error Message: null Stack Trace: java.lang.NullPointerException at org.apache.hadoop.hive.metastore.HiveMetaStore.getDelegationToken(HiveMetaStore.java:3499) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.getDelegationTokenStr(TestHadoop20SAuthBridge.java:298) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.obtainTokenAndAddIntoUGI(TestHadoop20SAuthBridge.java:305) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore(TestHadoop20SAuthBridge.java:214) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83) at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
[jira] [Created] (HIVE-2748) Upgrade Hbase and ZK dependcies
Upgrade Hbase and ZK dependcies --- Key: HIVE-2748 URL: https://issues.apache.org/jira/browse/HIVE-2748 Project: Hive Issue Type: Task Affects Versions: 0.8.0, 0.7.1, 0.7.0, 0.8.1, 0.9.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Both softwares have moved forward with significant improvements. Lets bump compile time dependency to keep up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2748) Upgrade Hbase and ZK dependcies
[ https://issues.apache.org/jira/browse/HIVE-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2748: -- Attachment: HIVE-2748.D1431.1.patch ashutoshc requested code review of HIVE-2748 [jira] Upgrade Hbase and ZK dependcies. Reviewers: JIRA https://issues.apache.org/jira/browse/HIVE-2748 Update HBase to 0.92 and ZK to 3.4.2 no code change except for minor changes in test code. Both softwares have moved forward with significant improvements. Lets bump compile time dependency to keep up TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D1431 AFFECTED FILES hbase-handler/src/test/org/apache/hadoop/hive/hbase/HBaseTestSetup.java ivy/libraries.properties MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/2967/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. Upgrade Hbase and ZK dependcies --- Key: HIVE-2748 URL: https://issues.apache.org/jira/browse/HIVE-2748 Project: Hive Issue Type: Task Affects Versions: 0.7.0, 0.7.1, 0.8.0, 0.8.1, 0.9.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-2748.D1431.1.patch Both softwares have moved forward with significant improvements. Lets bump compile time dependency to keep up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting
[ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2665: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Thomas! Support for metastore service specific HADOOP_OPTS environment setting -- Key: HIVE-2665 URL: https://issues.apache.org/jira/browse/HIVE-2665 Project: Hive Issue Type: Improvement Components: Metastore Affects Versions: 0.8.0, 0.9.0 Reporter: Thomas Weise Assignee: Thomas Weise Priority: Minor Fix For: 0.9.0 Attachments: HIVE-2665.patch For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-0.8.1-SNAPSHOT-h0.21 - Build # 175 - Still Failing
Changes for Build #173 Changes for Build #174 [cws] Set version to 0.8.1 (cws) Changes for Build #175 No tests ran. The Apache Jenkins build system has built Hive-0.8.1-SNAPSHOT-h0.21 (build #175) Status: Still Failing Check console output at https://builds.apache.org/job/Hive-0.8.1-SNAPSHOT-h0.21/175/ to view the results.
[jira] [Updated] (HIVE-2746) Metastore client doesn't log properly in case of connection failure to server
[ https://issues.apache.org/jira/browse/HIVE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2746: -- Attachment: HIVE-2746.D1395.2.patch ashutoshc updated the revision HIVE-2746 [jira] Metastore client doesn't log properly in case of connection failure to server. Reviewers: JIRA, cwsteinbach Incorporated Carl's suggestions. Fixed indentation. Moved both setugi functionality as well as secure transport setup outside of for loop, since retrials are for transport.open() and that code doesn't belong in for loop. REVISION DETAIL https://reviews.facebook.net/D1395 AFFECTED FILES metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java Metastore client doesn't log properly in case of connection failure to server - Key: HIVE-2746 URL: https://issues.apache.org/jira/browse/HIVE-2746 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.8.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-2746.D1395.1.patch, HIVE-2746.D1395.2.patch LOG.error(e.getStackTrace()) in current code prints memory location of StackTraceElement[] instead of message. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2686) Test ppr_pushdown.q is failing on trunk
[
https://issues.apache.org/jira/browse/HIVE-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193194#comment-13193194
]
Ashutosh Chauhan commented on HIVE-2686:
I think we shouldn't rewrite test queries which avoids union to make them pass.
If ordering issue arises because of HashMap Vs LinkedHashMap usage, lets fix
that.
Test ppr_pushdown.q is failing on trunk
---
Key: HIVE-2686
URL: https://issues.apache.org/jira/browse/HIVE-2686
Project: Hive
Issue Type: Test
Components: Testing Infrastructure
Affects Versions: 0.9.0
Reporter: Ashutosh Chauhan
Assignee: Navis
Priority: Minor
Fix For: 0.9.0
Attachments: HIVE-2686.D1215.1.patch
{noformat}
$ ant test -Dtestcase=TestCliDriver -Dqfile=ppr_pushdown.q
[junit] See build/ql/tmp/hive.log, or try ant test ...
-Dtest.silent=false to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown(TestCliDriver.java:129)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
[junit] 178d177
[junit] 12341234
[junit] 179a179
[junit] 12341234
[junit] 196d195
[junit] 12241224
[junit] 197a197
[junit] 12241224
[junit] 214d213
[junit] Exception: Client execution results failed with error code = 1
[junit] See build/ql/tmp/hive.log, or try ant test ...
-Dtest.silent=false to get more logs.
[junit] 12141214
[junit] 215a215
[junit] 12141214
[junit] 232d231
[junit] 12.412.4
[junit] 233a233
[junit] 12.412.4
[junit] 250d249
[junit] 12+412+4
[junit] 251a251
[junit] 12+412+4
[junit] 268d267
[junit] 12:412:4
[junit] 269a269
[junit] 12:412:4
[junit] 286d285
[junit] 12%412%4
[junit] 287a287
[junit] 12%412%4
[junit] 304d303
[junit] 12*412*4
[junit] 305a305
[junit] 12*412*4
[junit] Cleaning up TestCliDriver
[junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 137.556 sec
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-2727) add a testcase for partitioned view on union and base tables have index
[ https://issues.apache.org/jira/browse/HIVE-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain resolved HIVE-2727. -- Resolution: Fixed Hadoop Flags: Reviewed Committed. Thanks Yongqiang add a testcase for partitioned view on union and base tables have index --- Key: HIVE-2727 URL: https://issues.apache.org/jira/browse/HIVE-2727 Project: Hive Issue Type: Test Reporter: He Yongqiang Assignee: He Yongqiang Attachments: HIVE-2727.1.patch, HIVE-2727.D1323.1.patch, HIVE-2727.D1323.2.patch, HIVE-2727.D1323.3.patch, HIVE-2727.D1323.4.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2727) add a testcase for partitioned view on union and base tables have index
[ https://issues.apache.org/jira/browse/HIVE-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2727: --- Fix Version/s: 0.9.0 add a testcase for partitioned view on union and base tables have index --- Key: HIVE-2727 URL: https://issues.apache.org/jira/browse/HIVE-2727 Project: Hive Issue Type: Test Reporter: He Yongqiang Assignee: He Yongqiang Fix For: 0.9.0 Attachments: HIVE-2727.1.patch, HIVE-2727.D1323.1.patch, HIVE-2727.D1323.2.patch, HIVE-2727.D1323.3.patch, HIVE-2727.D1323.4.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2642) fix Hive-2566 and make union optimization more aggressive
[ https://issues.apache.org/jira/browse/HIVE-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2642: --- Fix Version/s: 0.9.0 fix Hive-2566 and make union optimization more aggressive -- Key: HIVE-2642 URL: https://issues.apache.org/jira/browse/HIVE-2642 Project: Hive Issue Type: Improvement Reporter: He Yongqiang Assignee: He Yongqiang Fix For: 0.9.0 Attachments: HIVE-2642.D735.1.patch Hive-2566 did some optimizations to union, but cause some problems. And then got reverted. This is to get it back and fix the problems we saw, and also make union optimization more aggressive. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2249) When creating constant expression for numbers, try to infer type from another comparison operand, instead of trying to use integer first, and then long and double
[
https://issues.apache.org/jira/browse/HIVE-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193227#comment-13193227
]
Phabricator commented on HIVE-2249:
---
kevinwilfong has commented on the revision HIVE-2249 [jira] When creating
constant expression for numbers, try to infer type from another comparison
operand, instead of trying to use integer first, and then long and double.
I looked at the tests that were failing:
insert2_overwrite_partitions.q orders by the column one, but since there are
several rows with the same value in column one, this does not guarantee a the
rows will be returned in the same order, and hence, with the limit 5, you are
not guaranteed to get the same rows. I'm not sure why your change would cause
the order to differ, but it shouldn't be an issue.
It looks like the order by was added to try and make the test deterministic.
Since your code can't be committed if tests are failing, could you change the
order by to be on one, two. This should guarantee you get the same rows every
time.
Also, it would probably be worth while to do this in
insert1_overwrite_partitions.q as well, as it does a similar order by.
I haven't been able to reproduce a failure in ppr_pushdown.q so far.
INLINE COMMENTS
ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java:709-712
This is never used.
REVISION DETAIL
https://reviews.facebook.net/D1383
When creating constant expression for numbers, try to infer type from another
comparison operand, instead of trying to use integer first, and then long and
double
--
Key: HIVE-2249
URL: https://issues.apache.org/jira/browse/HIVE-2249
Project: Hive
Issue Type: Improvement
Reporter: Siying Dong
Assignee: Joseph Barillari
Attachments: HIVE-2249.1.patch.txt, HIVE-2249.2.patch.txt,
HIVE-2249.D1383.1.patch
The current code to build constant expression for numbers, here is the code:
try {
v = Double.valueOf(expr.getText());
v = Long.valueOf(expr.getText());
v = Integer.valueOf(expr.getText());
} catch (NumberFormatException e) {
// do nothing here, we will throw an exception in the following block
}
if (v == null) {
throw new SemanticException(ErrorMsg.INVALID_NUMERICAL_CONSTANT
.getMsg(expr));
}
return new ExprNodeConstantDesc(v);
The for the case that WHERE BIG_INT_COLUMN = 0, or WHERE DOUBLE_COLUMN
= 0, we always have to do a type conversion when comparing, which is
unnecessary if it is slightly smarter to choose type when creating the
constant expression. We can simply walk one level up the tree, find another
comparison party and use the same type with that one if it is possible. For
user's wrong query like 'INT_COLUMN=1.1', we can even do more.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2249) When creating constant expression for numbers, try to infer type from another comparison operand, instead of trying to use integer first, and then long and double
[
https://issues.apache.org/jira/browse/HIVE-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193245#comment-13193245
]
Phabricator commented on HIVE-2249:
---
zhiqiu has commented on the revision HIVE-2249 [jira] When creating constant
expression for numbers, try to infer type from another comparison operand,
instead of trying to use integer first, and then long and double.
Thanks a lot, Kevin! I'll remove the un-used lines.
Just tried to update insert2_overwrite_partitions.q and
insert1_overwrite_partitions.q to add order by clause.
For ppr_pushdown, I think you analyses also apply. It failed on my side b/c
the query like this:
select * from ppr_test where ds = '1234'
The results on my machine are:
1234 1234
abcd 1234
while the expected outputs are:
abcd 1234
1234 1234
So I think it is good to also add order by to this case, right?
REVISION DETAIL
https://reviews.facebook.net/D1383
When creating constant expression for numbers, try to infer type from another
comparison operand, instead of trying to use integer first, and then long and
double
--
Key: HIVE-2249
URL: https://issues.apache.org/jira/browse/HIVE-2249
Project: Hive
Issue Type: Improvement
Reporter: Siying Dong
Assignee: Joseph Barillari
Attachments: HIVE-2249.1.patch.txt, HIVE-2249.2.patch.txt,
HIVE-2249.D1383.1.patch
The current code to build constant expression for numbers, here is the code:
try {
v = Double.valueOf(expr.getText());
v = Long.valueOf(expr.getText());
v = Integer.valueOf(expr.getText());
} catch (NumberFormatException e) {
// do nothing here, we will throw an exception in the following block
}
if (v == null) {
throw new SemanticException(ErrorMsg.INVALID_NUMERICAL_CONSTANT
.getMsg(expr));
}
return new ExprNodeConstantDesc(v);
The for the case that WHERE BIG_INT_COLUMN = 0, or WHERE DOUBLE_COLUMN
= 0, we always have to do a type conversion when comparing, which is
unnecessary if it is slightly smarter to choose type when creating the
constant expression. We can simply walk one level up the tree, find another
comparison party and use the same type with that one if it is possible. For
user's wrong query like 'INT_COLUMN=1.1', we can even do more.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2249) When creating constant expression for numbers, try to infer type from another comparison operand, instead of trying to use integer first, and then long and double
[
https://issues.apache.org/jira/browse/HIVE-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193387#comment-13193387
]
Phabricator commented on HIVE-2249:
---
zhiqiu has planned changes to the revision HIVE-2249 [jira] When creating
constant expression for numbers, try to infer type from another comparison
operand, instead of trying to use integer first, and then long and double.
* Remove unused lines (the set doubleTypes)
* Fix the test cases by adding sort by clause to the query: 1.
insert1_overwrite_partitions.q 2. insert2_overwrite_partitions.q 3.
ppr_pushdown
* Add test case for this new change on smart type inference
REVISION DETAIL
https://reviews.facebook.net/D1383
When creating constant expression for numbers, try to infer type from another
comparison operand, instead of trying to use integer first, and then long and
double
--
Key: HIVE-2249
URL: https://issues.apache.org/jira/browse/HIVE-2249
Project: Hive
Issue Type: Improvement
Reporter: Siying Dong
Assignee: Joseph Barillari
Attachments: HIVE-2249.1.patch.txt, HIVE-2249.2.patch.txt,
HIVE-2249.D1383.1.patch
The current code to build constant expression for numbers, here is the code:
try {
v = Double.valueOf(expr.getText());
v = Long.valueOf(expr.getText());
v = Integer.valueOf(expr.getText());
} catch (NumberFormatException e) {
// do nothing here, we will throw an exception in the following block
}
if (v == null) {
throw new SemanticException(ErrorMsg.INVALID_NUMERICAL_CONSTANT
.getMsg(expr));
}
return new ExprNodeConstantDesc(v);
The for the case that WHERE BIG_INT_COLUMN = 0, or WHERE DOUBLE_COLUMN
= 0, we always have to do a type conversion when comparing, which is
unnecessary if it is slightly smarter to choose type when creating the
constant expression. We can simply walk one level up the tree, find another
comparison party and use the same type with that one if it is possible. For
user's wrong query like 'INT_COLUMN=1.1', we can even do more.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1219 - Still Failing
Changes for Build #1184 [namit] HIVE-2690 a bug in 'alter table concatenate' that causes filenames getting double url encoded (He Yongqiang via namit) Changes for Build #1185 Changes for Build #1186 Changes for Build #1187 Changes for Build #1188 Changes for Build #1189 Changes for Build #1190 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1191 [amareshwari] HIVE-2629. Reverting previous commit Changes for Build #1192 [heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars (Kevin Wilfong via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2706 The issue was that the current thread's classloader and the classloader in the conf differed due to the prehook updating only the current thread's classloader with new jars. Now, it updates both classloaders, fixing the issue. When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error. Test Plan: Verified it fixed the stack overflow error. Reviewers: JIRA, heyongqiang, njain Reviewed By: heyongqiang CC: heyongqiang Differential Revision: https://reviews.facebook.net/D1167 Changes for Build #1193 [hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it shouldn't (jghoman via hashutosh) Changes for Build #1194 Changes for Build #1195 [hashutosh] HIVE-2589: Newly created partition should inherit properties from table (Ashutosh Chauhan) [hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan) Changes for Build #1196 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1197 Changes for Build #1198 [namit] HIVE-2504 Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Chinna Rao Lalam via namit) [namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit) Changes for Build #1199 Changes for Build #1200 Changes for Build #1201 Changes for Build #1202 Changes for Build #1203 Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 Changes for Build #1210 [namit] HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) Changes for Build #1211 [cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao Luo via cws) [cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws) Changes for Build #1212 [hashutosh] HIVE-2589 : Newly created partition should inherit properties from table (Ashutosh Chauhan) Changes for Build #1213 Changes for Build #1214 Changes for Build #1215 Changes for Build #1216 [cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws) Changes for Build #1217 Changes for Build #1218 Changes for Build #1219 [hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS environment setting (thw via hashutosh) 2 tests failed. FAILED: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_inputddl5 Error Message: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. Stack Trace: junit.framework.AssertionFailedError: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. at junit.framework.Assert.fail(Assert.java:50) at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_inputddl5(TestCliDriver.java:16883) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) at
[jira] [Commented] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting
[ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193403#comment-13193403 ] Hudson commented on HIVE-2665: -- Integrated in Hive-trunk-h0.21 #1219 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1219/]) HIVE-2665 : Support for metastore service specific HADOOP_OPTS environment setting (thw via hashutosh) hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1235845 Files : * /hive/trunk/bin/ext/metastore.sh Support for metastore service specific HADOOP_OPTS environment setting -- Key: HIVE-2665 URL: https://issues.apache.org/jira/browse/HIVE-2665 Project: Hive Issue Type: Improvement Components: Metastore Affects Versions: 0.8.0, 0.9.0 Reporter: Thomas Weise Assignee: Thomas Weise Priority: Minor Fix For: 0.9.0 Attachments: HIVE-2665.patch For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2749) CONV returns incorrect results sometimes
CONV returns incorrect results sometimes Key: HIVE-2749 URL: https://issues.apache.org/jira/browse/HIVE-2749 Project: Hive Issue Type: Bug Reporter: Jonathan Chang ...because it fails to reset state. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2749) CONV returns incorrect results sometimes
[ https://issues.apache.org/jira/browse/HIVE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2749: -- Attachment: HIVE-2749.D1437.1.patch jonchang requested code review of HIVE-2749 [jira] CONV returns incorrect results sometimes. Reviewers: JIRA HIVE-2749 ...because it fails to reset state. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D1437 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/udf/UDFConv.java ql/src/test/queries/clientpositive/udf_conv.q ql/src/test/results/clientpositive/udf_conv.q.out MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/2985/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. CONV returns incorrect results sometimes Key: HIVE-2749 URL: https://issues.apache.org/jira/browse/HIVE-2749 Project: Hive Issue Type: Bug Reporter: Jonathan Chang Attachments: HIVE-2749.D1437.1.patch ...because it fails to reset state. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2749) CONV returns incorrect results sometimes
[ https://issues.apache.org/jira/browse/HIVE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2749: -- Attachment: HIVE-2749.D1437.2.patch jonchang updated the revision HIVE-2749 [jira] CONV returns incorrect results sometimes. Reviewers: JIRA, jsichi, njain, nzhang, raghotham Fix docs. REVISION DETAIL https://reviews.facebook.net/D1437 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/udf/UDFConv.java ql/src/test/queries/clientpositive/udf_conv.q ql/src/test/results/clientpositive/udf_conv.q.out CONV returns incorrect results sometimes Key: HIVE-2749 URL: https://issues.apache.org/jira/browse/HIVE-2749 Project: Hive Issue Type: Bug Reporter: Jonathan Chang Attachments: HIVE-2749.D1437.1.patch, HIVE-2749.D1437.2.patch ...because it fails to reset state. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2746) Metastore client doesn't log properly in case of connection failure to server
[ https://issues.apache.org/jira/browse/HIVE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2746: --- Status: Patch Available (was: Open) All the tests passed with latest patch except for insert2_overwrite_partitions.q which seems unrelated to this patch and randomly fails on trunk. Metastore client doesn't log properly in case of connection failure to server - Key: HIVE-2746 URL: https://issues.apache.org/jira/browse/HIVE-2746 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.8.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-2746.D1395.1.patch, HIVE-2746.D1395.2.patch LOG.error(e.getStackTrace()) in current code prints memory location of StackTraceElement[] instead of message. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2727) add a testcase for partitioned view on union and base tables have index
[ https://issues.apache.org/jira/browse/HIVE-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193446#comment-13193446 ] Hudson commented on HIVE-2727: -- Integrated in Hive-trunk-h0.21 #1220 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1220/]) HIVE-2727 add a testcase for partitioned view on union and base tables have index (He Yongqiang via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1235864 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/index/IndexMetadataChangeTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/index/compact/CompactIndexHandler.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/IndexUtils.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java * /hive/trunk/ql/src/test/queries/clientpositive/union_view.q * /hive/trunk/ql/src/test/results/clientpositive/union_view.q.out add a testcase for partitioned view on union and base tables have index --- Key: HIVE-2727 URL: https://issues.apache.org/jira/browse/HIVE-2727 Project: Hive Issue Type: Test Reporter: He Yongqiang Assignee: He Yongqiang Fix For: 0.9.0 Attachments: HIVE-2727.1.patch, HIVE-2727.D1323.1.patch, HIVE-2727.D1323.2.patch, HIVE-2727.D1323.3.patch, HIVE-2727.D1323.4.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1220 - Still Failing
Changes for Build #1185 Changes for Build #1186 Changes for Build #1187 Changes for Build #1188 Changes for Build #1189 Changes for Build #1190 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1191 [amareshwari] HIVE-2629. Reverting previous commit Changes for Build #1192 [heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars (Kevin Wilfong via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2706 The issue was that the current thread's classloader and the classloader in the conf differed due to the prehook updating only the current thread's classloader with new jars. Now, it updates both classloaders, fixing the issue. When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error. Test Plan: Verified it fixed the stack overflow error. Reviewers: JIRA, heyongqiang, njain Reviewed By: heyongqiang CC: heyongqiang Differential Revision: https://reviews.facebook.net/D1167 Changes for Build #1193 [hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it shouldn't (jghoman via hashutosh) Changes for Build #1194 Changes for Build #1195 [hashutosh] HIVE-2589: Newly created partition should inherit properties from table (Ashutosh Chauhan) [hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan) Changes for Build #1196 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1197 Changes for Build #1198 [namit] HIVE-2504 Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Chinna Rao Lalam via namit) [namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit) Changes for Build #1199 Changes for Build #1200 Changes for Build #1201 Changes for Build #1202 Changes for Build #1203 Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 Changes for Build #1210 [namit] HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) Changes for Build #1211 [cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao Luo via cws) [cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws) Changes for Build #1212 [hashutosh] HIVE-2589 : Newly created partition should inherit properties from table (Ashutosh Chauhan) Changes for Build #1213 Changes for Build #1214 Changes for Build #1215 Changes for Build #1216 [cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws) Changes for Build #1217 Changes for Build #1218 Changes for Build #1219 [hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS environment setting (thw via hashutosh) Changes for Build #1220 [namit] HIVE-2727 add a testcase for partitioned view on union and base tables have index (He Yongqiang via namit) No tests ran. The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1220) Status: Still Failing Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1220/ to view the results.
[jira] [Updated] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2734: --- Status: Open (was: Patch Available) Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1365.1.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1425.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2734: --- Description: Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit was: Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1365.1.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1425.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2746) Metastore client doesn't log properly in case of connection failure to server
[ https://issues.apache.org/jira/browse/HIVE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193458#comment-13193458 ] Phabricator commented on HIVE-2746: --- cwsteinbach has accepted the revision HIVE-2746 [jira] Metastore client doesn't log properly in case of connection failure to server. +1 REVISION DETAIL https://reviews.facebook.net/D1395 Metastore client doesn't log properly in case of connection failure to server - Key: HIVE-2746 URL: https://issues.apache.org/jira/browse/HIVE-2746 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.8.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-2746.D1395.1.patch, HIVE-2746.D1395.2.patch LOG.error(e.getStackTrace()) in current code prints memory location of StackTraceElement[] instead of message. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2734: -- Attachment: HIVE-2734.D1443.1.patch zhenxiao requested code review of HIVE-2734 [jira] Fix some nondeterministic test output. Reviewers: JIRA HIVE-2734: Fix some nondeterministic test output Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D1443 AFFECTED FILES ql/src/test/queries/clientpositive/columnarserde_create_shortcut.q ql/src/test/queries/clientpositive/combine1.q ql/src/test/queries/clientpositive/global_limit.q ql/src/test/queries/clientpositive/groupby1_limit.q ql/src/test/queries/clientpositive/input11_limit.q ql/src/test/queries/clientpositive/input1_limit.q ql/src/test/queries/clientpositive/input_lazyserde.q ql/src/test/queries/clientpositive/join18_multi_distinct.q ql/src/test/queries/clientpositive/join_1to1.q ql/src/test/queries/clientpositive/join_casesensitive.q ql/src/test/queries/clientpositive/join_filters.q ql/src/test/queries/clientpositive/join_nulls.q ql/src/test/queries/clientpositive/merge3.q ql/src/test/queries/clientpositive/rcfile_columnar.q ql/src/test/queries/clientpositive/rcfile_lazydecompress.q ql/src/test/queries/clientpositive/rcfile_union.q ql/src/test/queries/clientpositive/sample10.q ql/src/test/queries/clientpositive/udf_sentences.q ql/src/test/queries/clientpositive/union24.q ql/src/test/results/clientpositive/columnarserde_create_shortcut.q.out ql/src/test/results/clientpositive/combine1.q.out ql/src/test/results/clientpositive/global_limit.q.out ql/src/test/results/clientpositive/groupby1_limit.q.out ql/src/test/results/clientpositive/input11_limit.q.out ql/src/test/results/clientpositive/input1_limit.q.out ql/src/test/results/clientpositive/input_lazyserde.q.out ql/src/test/results/clientpositive/join18_multi_distinct.q.out ql/src/test/results/clientpositive/join_1to1.q.out ql/src/test/results/clientpositive/join_casesensitive.q.out ql/src/test/results/clientpositive/join_filters.q.out ql/src/test/results/clientpositive/join_nulls.q.out ql/src/test/results/clientpositive/merge3.q.out ql/src/test/results/clientpositive/rcfile_columnar.q.out ql/src/test/results/clientpositive/rcfile_lazydecompress.q.out ql/src/test/results/clientpositive/rcfile_union.q.out ql/src/test/results/clientpositive/sample10.q.out ql/src/test/results/clientpositive/udf_sentences.q.out ql/src/test/results/clientpositive/union24.q.out MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/3003/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1365.1.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1443.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193480#comment-13193480 ] Phabricator commented on HIVE-2734: --- zhenxiao has commented on the revision HIVE-2734 [jira] Fix some nondeterministic test output. patch for branch-0.8-r2 REVISION DETAIL https://reviews.facebook.net/D1443 Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1365.1.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1443.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[VOTE] Apache Hive 0.8.1 Release Candidate 1
Apache Hive 0.8.1 Release Candidate 1 is available here: http://people.apache.org/~cws/hive-0.8.1-candidate-1 Maven artifacts are available here: https://repository.apache.org/content/repositories/orgapachehive-138/ Changes since version 0.8.0: * HIVE-BUILD. Set version to 0.8.1 * HIVE-2589. Newly created partition should inherit properties from table * HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0 * HIVE-2616. Passing user identity from metastore client to server in non-secure mode * HIVE-2631. Make Hive work with Hadoop 1.0.0 Voting will conclude in 72 hours. Please test and vote. Thanks. Carl
[jira] [Updated] (HIVE-2746) Metastore client doesn't log properly in case of connection failure to server
[ https://issues.apache.org/jira/browse/HIVE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2746: --- Attachment: hive-2746.patch Patch with appropriate appropriate grant perms. Going to commit soon. Metastore client doesn't log properly in case of connection failure to server - Key: HIVE-2746 URL: https://issues.apache.org/jira/browse/HIVE-2746 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.8.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-2746.D1395.1.patch, HIVE-2746.D1395.2.patch, hive-2746.patch LOG.error(e.getStackTrace()) in current code prints memory location of StackTraceElement[] instead of message. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193503#comment-13193503 ] Phabricator commented on HIVE-2734: --- zhenxiao has commented on the revision HIVE-2734 [jira] Fix some nondeterministic test output. This is the patch for trunk REVISION DETAIL https://reviews.facebook.net/D1449 Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1365.1.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1443.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2748) Upgrade Hbase and ZK dependcies
[ https://issues.apache.org/jira/browse/HIVE-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193508#comment-13193508 ] Phabricator commented on HIVE-2748: --- cwsteinbach has accepted the revision HIVE-2748 [jira] Upgrade Hbase and ZK dependcies. +1 @Ashutosh: Can you test and commit? REVISION DETAIL https://reviews.facebook.net/D1431 Upgrade Hbase and ZK dependcies --- Key: HIVE-2748 URL: https://issues.apache.org/jira/browse/HIVE-2748 Project: Hive Issue Type: Task Affects Versions: 0.7.0, 0.7.1, 0.8.0, 0.8.1, 0.9.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-2748.D1431.1.patch Both softwares have moved forward with significant improvements. Lets bump compile time dependency to keep up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2698) Enable Hadoop-1.0.0 in Hive
[ https://issues.apache.org/jira/browse/HIVE-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2698: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed to trunk. Thanks Enis! Enable Hadoop-1.0.0 in Hive --- Key: HIVE-2698 URL: https://issues.apache.org/jira/browse/HIVE-2698 Project: Hive Issue Type: New Feature Components: Security, Shims Affects Versions: 0.9.0 Reporter: Enis Soztutar Assignee: Enis Soztutar Labels: hadoop, hadoop-1.0, jars Attachments: HIVE-2698.D1389.1.patch, HIVE-2698.D1389.2.patch, HIVE-2698.D1389.2.patch, HIVE-2698_v1.patch, HIVE-2698_v2.patch, HIVE-2698_v3.patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2734: --- Status: Patch Available (was: Open) Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1365.1.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1443.1.patch, HIVE-2734.D1443.1.patch, HIVE-2734.D1449.1.patch, HIVE-2734.D1449.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2734: --- Attachment: HIVE-2734.D1449.1.patch HIVE-2734.D1443.1.patch Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1365.1.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1443.1.patch, HIVE-2734.D1443.1.patch, HIVE-2734.D1449.1.patch, HIVE-2734.D1449.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2750) Hive multi group by single reducer optimization causes invalid column reference error
Hive multi group by single reducer optimization causes invalid column reference error - Key: HIVE-2750 URL: https://issues.apache.org/jira/browse/HIVE-2750 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong After the optimization, if two query blocks have the same distinct clause and the same group by keys, but the first query block does not reference all the rows the second query block does, an invalid column reference error is raised for the columns unreferenced in the first query block. E.g. FROM src INSERT OVERWRITE TABLE dest_g2 SELECT substr(src.key,1,1), count(DISTINCT src.key) WHERE substr(src.key,1,1) = 5 GROUP BY substr(src.key,1,1) INSERT OVERWRITE TABLE dest_g3 SELECT substr(src.key,1,1), count(DISTINCT src.key), count(src.value) WHERE substr(src.key,1,1) 5 GROUP BY substr(src.key,1,1); This results in an invalid column reference error on src.value -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2698) Enable Hadoop-1.0.0 in Hive
[ https://issues.apache.org/jira/browse/HIVE-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193516#comment-13193516 ] Phabricator commented on HIVE-2698: --- enis has committed the revision HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive. Change committed by cws. REVISION DETAIL https://reviews.facebook.net/D1389 COMMIT https://reviews.facebook.net/rHIVE1236023 Enable Hadoop-1.0.0 in Hive --- Key: HIVE-2698 URL: https://issues.apache.org/jira/browse/HIVE-2698 Project: Hive Issue Type: New Feature Components: Security, Shims Affects Versions: 0.9.0 Reporter: Enis Soztutar Assignee: Enis Soztutar Labels: hadoop, hadoop-1.0, jars Attachments: HIVE-2698.D1389.1.patch, HIVE-2698.D1389.2.patch, HIVE-2698.D1389.2.patch, HIVE-2698_v1.patch, HIVE-2698_v2.patch, HIVE-2698_v3.patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2748) Upgrade Hbase and ZK dependcies
[ https://issues.apache.org/jira/browse/HIVE-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193524#comment-13193524 ] Phabricator commented on HIVE-2748: --- cwsteinbach has requested changes to the revision HIVE-2748 [jira] Upgrade Hbase and ZK dependcies. INLINE COMMENTS ivy/libraries.properties:41 0.92.0 has been released. Let's use that instead of the SNAPSHOT. REVISION DETAIL https://reviews.facebook.net/D1431 Upgrade Hbase and ZK dependcies --- Key: HIVE-2748 URL: https://issues.apache.org/jira/browse/HIVE-2748 Project: Hive Issue Type: Task Affects Versions: 0.7.0, 0.7.1, 0.8.0, 0.8.1, 0.9.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-2748.D1431.1.patch Both softwares have moved forward with significant improvements. Lets bump compile time dependency to keep up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2748) Upgrade Hbase and ZK dependcies
[ https://issues.apache.org/jira/browse/HIVE-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193526#comment-13193526 ] Phabricator commented on HIVE-2748: --- ashutoshc has commented on the revision HIVE-2748 [jira] Upgrade Hbase and ZK dependcies. INLINE COMMENTS ivy/libraries.properties:41 Yeah, thats what I intend to do. 0.92 is not available on mvn repos yet. As soon as its there, I will update the patch for it and then test. REVISION DETAIL https://reviews.facebook.net/D1431 Upgrade Hbase and ZK dependcies --- Key: HIVE-2748 URL: https://issues.apache.org/jira/browse/HIVE-2748 Project: Hive Issue Type: Task Affects Versions: 0.7.0, 0.7.1, 0.8.0, 0.8.1, 0.9.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: HIVE-2748.D1431.1.patch Both softwares have moved forward with significant improvements. Lets bump compile time dependency to keep up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193527#comment-13193527 ] Phabricator commented on HIVE-2734: --- cwsteinbach has accepted the revision HIVE-2734 [jira] Fix some nondeterministic test output. +1. Will commit if tests pass. REVISION DETAIL https://reviews.facebook.net/D1449 Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1359.2.patch, HIVE-2734.D1365.1.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1365.2.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1419.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1425.1.patch, HIVE-2734.D1443.1.patch, HIVE-2734.D1443.1.patch, HIVE-2734.D1449.1.patch, HIVE-2734.D1449.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2746) Metastore client doesn't log properly in case of connection failure to server
[ https://issues.apache.org/jira/browse/HIVE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2746: --- Resolution: Fixed Fix Version/s: 0.9.0 Status: Resolved (was: Patch Available) Committed to trunk. Metastore client doesn't log properly in case of connection failure to server - Key: HIVE-2746 URL: https://issues.apache.org/jira/browse/HIVE-2746 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.8.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.9.0 Attachments: HIVE-2746.D1395.1.patch, HIVE-2746.D1395.2.patch, hive-2746.patch LOG.error(e.getStackTrace()) in current code prints memory location of StackTraceElement[] instead of message. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2750) Hive multi group by single reducer optimization causes invalid column reference error
[ https://issues.apache.org/jira/browse/HIVE-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-2750: Status: Patch Available (was: Open) Hive multi group by single reducer optimization causes invalid column reference error - Key: HIVE-2750 URL: https://issues.apache.org/jira/browse/HIVE-2750 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2750.D1455.1.patch After the optimization, if two query blocks have the same distinct clause and the same group by keys, but the first query block does not reference all the rows the second query block does, an invalid column reference error is raised for the columns unreferenced in the first query block. E.g. FROM src INSERT OVERWRITE TABLE dest_g2 SELECT substr(src.key,1,1), count(DISTINCT src.key) WHERE substr(src.key,1,1) = 5 GROUP BY substr(src.key,1,1) INSERT OVERWRITE TABLE dest_g3 SELECT substr(src.key,1,1), count(DISTINCT src.key), count(src.value) WHERE substr(src.key,1,1) 5 GROUP BY substr(src.key,1,1); This results in an invalid column reference error on src.value -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2750) Hive multi group by single reducer optimization causes invalid column reference error
[ https://issues.apache.org/jira/browse/HIVE-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2750: -- Attachment: HIVE-2750.D1455.1.patch kevinwilfong requested code review of HIVE-2750 [jira] Hive multi group by single reducer optimization causes invalid column reference error. Reviewers: JIRA When generating the list of value columns for the reduce sink operator, in the case of multiple group bys occurring in the same reducer, only the columns used by the first query block was being considered, due to a typo. This patch fixes this typo, and adds a testcase to ensure the error does not reoccur. After the optimization, if two query blocks have the same distinct clause and the same group by keys, but the first query block does not reference all the rows the second query block does, an invalid column reference error is raised for the columns unreferenced in the first query block. E.g. FROM src INSERT OVERWRITE TABLE dest_g2 SELECT substr(src.key,1,1), count(DISTINCT src.key) WHERE substr(src.key,1,1) = 5 GROUP BY substr(src.key,1,1) INSERT OVERWRITE TABLE dest_g3 SELECT substr(src.key,1,1), count(DISTINCT src.key), count(src.value) WHERE substr(src.key,1,1) 5 GROUP BY substr(src.key,1,1); This results in an invalid column reference error on src.value TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D1455 AFFECTED FILES ql/src/test/results/clientpositive/groupby_multi_single_reducer2.q.out ql/src/test/queries/clientpositive/groupby_multi_single_reducer2.q ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/3015/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. Hive multi group by single reducer optimization causes invalid column reference error - Key: HIVE-2750 URL: https://issues.apache.org/jira/browse/HIVE-2750 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2750.D1455.1.patch After the optimization, if two query blocks have the same distinct clause and the same group by keys, but the first query block does not reference all the rows the second query block does, an invalid column reference error is raised for the columns unreferenced in the first query block. E.g. FROM src INSERT OVERWRITE TABLE dest_g2 SELECT substr(src.key,1,1), count(DISTINCT src.key) WHERE substr(src.key,1,1) = 5 GROUP BY substr(src.key,1,1) INSERT OVERWRITE TABLE dest_g3 SELECT substr(src.key,1,1), count(DISTINCT src.key), count(src.value) WHERE substr(src.key,1,1) 5 GROUP BY substr(src.key,1,1); This results in an invalid column reference error on src.value -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2686) Test ppr_pushdown.q is failing on trunk
[
https://issues.apache.org/jira/browse/HIVE-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193538#comment-13193538
]
Navis commented on HIVE-2686:
-
Agreed. But I suggest making another test for union ordering. The
ppr_pushdown.q uses insert/union 8 times which induces 4 MR for each, making
test time very long (1m 40s for my notebook).
And.. I found HIVE-2642 prepended TSs for each input, which making input splits
for each. Before that same union operator made every inputs to be combined to
single split. Was this intentional?
Test ppr_pushdown.q is failing on trunk
---
Key: HIVE-2686
URL: https://issues.apache.org/jira/browse/HIVE-2686
Project: Hive
Issue Type: Test
Components: Testing Infrastructure
Affects Versions: 0.9.0
Reporter: Ashutosh Chauhan
Assignee: Navis
Priority: Minor
Fix For: 0.9.0
Attachments: HIVE-2686.D1215.1.patch
{noformat}
$ ant test -Dtestcase=TestCliDriver -Dqfile=ppr_pushdown.q
[junit] See build/ql/tmp/hive.log, or try ant test ...
-Dtest.silent=false to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown(TestCliDriver.java:129)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
[junit] 178d177
[junit] 12341234
[junit] 179a179
[junit] 12341234
[junit] 196d195
[junit] 12241224
[junit] 197a197
[junit] 12241224
[junit] 214d213
[junit] Exception: Client execution results failed with error code = 1
[junit] See build/ql/tmp/hive.log, or try ant test ...
-Dtest.silent=false to get more logs.
[junit] 12141214
[junit] 215a215
[junit] 12141214
[junit] 232d231
[junit] 12.412.4
[junit] 233a233
[junit] 12.412.4
[junit] 250d249
[junit] 12+412+4
[junit] 251a251
[junit] 12+412+4
[junit] 268d267
[junit] 12:412:4
[junit] 269a269
[junit] 12:412:4
[junit] 286d285
[junit] 12%412%4
[junit] 287a287
[junit] 12%412%4
[junit] 304d303
[junit] 12*412*4
[junit] 305a305
[junit] 12*412*4
[junit] Cleaning up TestCliDriver
[junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 137.556 sec
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2750) Hive multi group by single reducer optimization causes invalid column reference error
[ https://issues.apache.org/jira/browse/HIVE-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193555#comment-13193555 ] Namit Jain commented on HIVE-2750: -- +1 Hive multi group by single reducer optimization causes invalid column reference error - Key: HIVE-2750 URL: https://issues.apache.org/jira/browse/HIVE-2750 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2750.D1455.1.patch After the optimization, if two query blocks have the same distinct clause and the same group by keys, but the first query block does not reference all the rows the second query block does, an invalid column reference error is raised for the columns unreferenced in the first query block. E.g. FROM src INSERT OVERWRITE TABLE dest_g2 SELECT substr(src.key,1,1), count(DISTINCT src.key) WHERE substr(src.key,1,1) = 5 GROUP BY substr(src.key,1,1) INSERT OVERWRITE TABLE dest_g3 SELECT substr(src.key,1,1), count(DISTINCT src.key), count(src.value) WHERE substr(src.key,1,1) 5 GROUP BY substr(src.key,1,1); This results in an invalid column reference error on src.value -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2751) Hive needs a framework for end to end testing
Hive needs a framework for end to end testing - Key: HIVE-2751 URL: https://issues.apache.org/jira/browse/HIVE-2751 Project: Hive Issue Type: Test Components: Testing Infrastructure Affects Versions: 0.8.0 Reporter: Esteban Gutierrez Hive tests do a really nice work, but it would be nice to have end to end tests like in Pig: PIG-1899 Implementing an end to end testing framework can offer the possibility for Hive developers to verify the functionality at scale. Users could use this testing framework in continuous integration environments (Jenkins) before deploying Hive into production environments. Some of the required changes are: * Building a test data generator * Modifying the existing tests so they can be run in a real cluster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2751) Hive needs a framework for end to end testing
[ https://issues.apache.org/jira/browse/HIVE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193587#comment-13193587 ] Ashutosh Chauhan commented on HIVE-2751: Take a look at HIVE-2670 Is it similar to what you have in mind or different? Hive needs a framework for end to end testing - Key: HIVE-2751 URL: https://issues.apache.org/jira/browse/HIVE-2751 Project: Hive Issue Type: Test Components: Testing Infrastructure Affects Versions: 0.8.0 Reporter: Esteban Gutierrez Hive tests do a really nice work, but it would be nice to have end to end tests like in Pig: PIG-1899 Implementing an end to end testing framework can offer the possibility for Hive developers to verify the functionality at scale. Users could use this testing framework in continuous integration environments (Jenkins) before deploying Hive into production environments. Some of the required changes are: * Building a test data generator * Modifying the existing tests so they can be run in a real cluster. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2609) NPE when pruning partitions by thrift method get_partitions_by_filter
[
https://issues.apache.org/jira/browse/HIVE-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193593#comment-13193593
]
Aniket Mokashi commented on HIVE-2609:
--
Hmm, unfortunately it didnt work for me, I am not at hive0.9 yet, that might be
one of the reason. Anyway, for those who want take jar injection path
-http://www.datanucleus.org/servlet/jira/browse/NUCJDOQUERY-4
NPE when pruning partitions by thrift method get_partitions_by_filter
-
Key: HIVE-2609
URL: https://issues.apache.org/jira/browse/HIVE-2609
Project: Hive
Issue Type: Bug
Components: Metastore
Affects Versions: 0.7.1
Reporter: Min Zhou
It's a datanucleus bug indeed.
try this code:
{code}
boolean open = false;
for (int i = 0; i 5 !open; ++i) {
try {
transport.open();
open = true;
} catch (TTransportException e) {
System.out.println(failed to connect to MetaStore, re-trying...);
try {
Thread.sleep(1000);
} catch (InterruptedException ignore) {}
}
}
try {
ListPartition parts =
client.get_partitions_by_filter(default, partitioned_nation,
pt '2', (short) -1);
for (Partition part : parts) {
System.out.println(part.getSd().getLocation());
}
} catch (Exception te) {
te.printStackTrace();
}
{code}
A NPEexception would be thrown on the thrift server side
{noformat}
11/11/25 13:11:55 ERROR api.ThriftHiveMetastore$Processor: Internal error
processing get_partitions_by_filter
java.lang.NullPointerException
at
org.datanucleus.store.mapped.mapping.MappingHelper.getMappingIndices(MappingHelper.java:35)
at
org.datanucleus.store.mapped.expression.StatementText.applyParametersToStatement(StatementText.java:194)
at
org.datanucleus.store.rdbms.query.RDBMSQueryUtils.getPreparedStatementForQuery(RDBMSQueryUtils.java:233)
at
org.datanucleus.store.rdbms.query.legacy.SQLEvaluator.evaluate(SQLEvaluator.java:115)
at
org.datanucleus.store.rdbms.query.legacy.JDOQLQuery.performExecute(JDOQLQuery.java:288)
at org.datanucleus.store.query.Query.executeQuery(Query.java:1657)
at
org.datanucleus.store.rdbms.query.legacy.JDOQLQuery.executeQuery(JDOQLQuery.java:245)
at org.datanucleus.store.query.Query.executeWithMap(Query.java:1526)
at org.datanucleus.jdo.JDOQuery.executeWithMap(JDOQuery.java:334)
at
org.apache.hadoop.hive.metastore.ObjectStore.listMPartitionsByFilter(ObjectStore.java:1329)
at
org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByFilter(ObjectStore.java:1241)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler$40.run(HiveMetaStore.java:2369)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler$40.run(HiveMetaStore.java:2366)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.executeWithRetry(HiveMetaStore.java:307)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_filter(HiveMetaStore.java:2366)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_filter.process(ThriftHiveMetastore.j
ava:6099)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor.process(ThriftHiveMetastore.java:4789)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$TLoggingProcessor.process(HiveMetaStore.java:3167)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:253)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
{noformat}
A null JavaTypeMapping was passed into
org.datanucleus.store.mapped.mapping.MappingHelper.(int initialPosition,
JavaTypeMapping mapping), that caused NPE.
After digged into the datanucleus source, I found that the null value was
born in the constructor of
org.datanucleus.store.mapped.expression.SubstringExpression. see
{code}
/**
* Constructs the substring
* @param str the String Expression
* @param begin The start position
* @param end The end position expression
**/
public SubstringExpression(StringExpression str, NumericExpression begin,
NumericExpression end)
{
super(str.getQueryExpression());
st.append(SUBSTRING().append(str).append( FROM )
.append(begin.add(new IntegerLiteral(qs, mapping,
BigInteger.ONE)))
.append( FOR ).append(end.sub(begin)).append(')');
}
{code}
The field mapping hasn't been instanced at that moment.
How do you deal with such a external
[jira] [Commented] (HIVE-2698) Enable Hadoop-1.0.0 in Hive
[ https://issues.apache.org/jira/browse/HIVE-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193620#comment-13193620 ] Hudson commented on HIVE-2698: -- Integrated in Hive-trunk-h0.21 #1221 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1221/]) HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive (Enis Söztutar via Carl Steinbach) Summary: third version of the patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach CC: cwsteinbach, enis Differential Revision: https://reviews.facebook.net/D1389 cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1236023 Files : * /hive/trunk/build.properties Enable Hadoop-1.0.0 in Hive --- Key: HIVE-2698 URL: https://issues.apache.org/jira/browse/HIVE-2698 Project: Hive Issue Type: New Feature Components: Security, Shims Affects Versions: 0.9.0 Reporter: Enis Soztutar Assignee: Enis Soztutar Labels: hadoop, hadoop-1.0, jars Attachments: HIVE-2698.D1389.1.patch, HIVE-2698.D1389.2.patch, HIVE-2698.D1389.2.patch, HIVE-2698_v1.patch, HIVE-2698_v2.patch, HIVE-2698_v3.patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2746) Metastore client doesn't log properly in case of connection failure to server
[ https://issues.apache.org/jira/browse/HIVE-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13193621#comment-13193621 ] Hudson commented on HIVE-2746: -- Integrated in Hive-trunk-h0.21 #1221 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1221/]) HIVE-2746 : Metastore client doesn't log properly in case of connection failure to server (hashutosh) hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1236025 Files : * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java Metastore client doesn't log properly in case of connection failure to server - Key: HIVE-2746 URL: https://issues.apache.org/jira/browse/HIVE-2746 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.8.0 Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.9.0 Attachments: HIVE-2746.D1395.1.patch, HIVE-2746.D1395.2.patch, hive-2746.patch LOG.error(e.getStackTrace()) in current code prints memory location of StackTraceElement[] instead of message. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1221 - Still Failing
Changes for Build #1185 Changes for Build #1186 Changes for Build #1187 Changes for Build #1188 Changes for Build #1189 Changes for Build #1190 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1191 [amareshwari] HIVE-2629. Reverting previous commit Changes for Build #1192 [heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars (Kevin Wilfong via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2706 The issue was that the current thread's classloader and the classloader in the conf differed due to the prehook updating only the current thread's classloader with new jars. Now, it updates both classloaders, fixing the issue. When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error. Test Plan: Verified it fixed the stack overflow error. Reviewers: JIRA, heyongqiang, njain Reviewed By: heyongqiang CC: heyongqiang Differential Revision: https://reviews.facebook.net/D1167 Changes for Build #1193 [hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it shouldn't (jghoman via hashutosh) Changes for Build #1194 Changes for Build #1195 [hashutosh] HIVE-2589: Newly created partition should inherit properties from table (Ashutosh Chauhan) [hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan) Changes for Build #1196 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1197 Changes for Build #1198 [namit] HIVE-2504 Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Chinna Rao Lalam via namit) [namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit) Changes for Build #1199 Changes for Build #1200 Changes for Build #1201 Changes for Build #1202 Changes for Build #1203 Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 Changes for Build #1210 [namit] HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) Changes for Build #1211 [cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao Luo via cws) [cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws) Changes for Build #1212 [hashutosh] HIVE-2589 : Newly created partition should inherit properties from table (Ashutosh Chauhan) Changes for Build #1213 Changes for Build #1214 Changes for Build #1215 Changes for Build #1216 [cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws) Changes for Build #1217 Changes for Build #1218 Changes for Build #1219 [hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS environment setting (thw via hashutosh) Changes for Build #1220 [namit] HIVE-2727 add a testcase for partitioned view on union and base tables have index (He Yongqiang via namit) Changes for Build #1221 [hashutosh] HIVE-2746 : Metastore client doesn't log properly in case of connection failure to server (hashutosh) [cws] HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive (Enis Söztutar via Carl Steinbach) Summary: third version of the patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach CC: cwsteinbach, enis Differential Revision: https://reviews.facebook.net/D1389 3 tests failed. REGRESSION: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert2_overwrite_partitions Error Message: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. Stack Trace: junit.framework.AssertionFailedError: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. at junit.framework.Assert.fail(Assert.java:50) at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert2_overwrite_partitions(TestCliDriver.java:17172) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at
