[jira] [Updated] (HIVE-2709) Semantic Analysis failed for GroupBy query with aliase.
[ https://issues.apache.org/jira/browse/HIVE-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2709: -- Attachment: HIVE-2709.D1305.2.patch navis updated the revision HIVE-2709 [jira] Semantic Analysis failed for GroupBy query with aliase.. Reviewers: JIRA support searching table.column from column name move notable_alias3 to positive REVISION DETAIL https://reviews.facebook.net/D1305 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/parse/ExprRowResolver.java ql/src/java/org/apache/hadoop/hive/ql/parse/RowResolver.java ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java ql/src/test/queries/clientpositive/groupby_alias.q ql/src/test/queries/clientpositive/notable_alias3.q ql/src/test/queries/clientnegative/notable_alias3.q ql/src/test/results/clientpositive/groupby_alias.q.out ql/src/test/results/clientpositive/notable_alias3.q.out Semantic Analysis failed for GroupBy query with aliase. --- Key: HIVE-2709 URL: https://issues.apache.org/jira/browse/HIVE-2709 Project: Hive Issue Type: Bug Components: SQL Affects Versions: 0.8.0 Environment: SuSE11 SP1 Reporter: rohithsharma Priority: Minor Attachments: HIVE-2709.1.patch.txt, HIVE-2709.D1305.1.patch, HIVE-2709.D1305.2.patch In the SQL , select empno from test t group by t.empno type of query work fine where as in hive ,below exception org.apache.hadoop.hive.ql.parse.SemanticException: line 1:7 Expression Not In Group By Key ename. For the above, column_name with aliase work fine i.e select t.empno from test t group by t.empno is work fine. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2340) optimize orderby followed by a groupby
[ https://issues.apache.org/jira/browse/HIVE-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2340: -- Attachment: HIVE-2340.D1209.3.patch navis updated the revision HIVE-2340 [jira] optimize orderby followed by a groupby. Reviewers: JIRA fix test failures : auto_join26.q, ql_rewrite_gbtoidx.q, udtf_json_tuple.q, union24.q REVISION DETAIL https://reviews.facebook.net/D1209 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/optimizer/ColumnPrunerProcFactory.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/ReduceSinkDeDuplication.java ql/src/test/queries/clientpositive/auto_join26.q ql/src/test/queries/clientpositive/ql_rewrite_gbtoidx.q ql/src/test/queries/clientpositive/reduce_deduplicate_extended.q ql/src/test/queries/clientpositive/udtf_json_tuple.q ql/src/test/queries/clientpositive/union24.q ql/src/test/results/clientpositive/reduce_deduplicate_extended.q.out optimize orderby followed by a groupby -- Key: HIVE-2340 URL: https://issues.apache.org/jira/browse/HIVE-2340 Project: Hive Issue Type: Sub-task Components: Query Processor Reporter: Navis Assignee: Navis Priority: Minor Attachments: HIVE-2340.1.patch.txt, HIVE-2340.D1209.1.patch, HIVE-2340.D1209.2.patch, HIVE-2340.D1209.3.patch Before implementing optimizer for JOIN-GBY, try to implement RS-GBY optimizer(cluster-by following group-by). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2725) Fix flaky testing infrastructure
[ https://issues.apache.org/jira/browse/HIVE-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13189979#comment-13189979 ] Ashutosh Chauhan commented on HIVE-2725: Thanks, Carl for looking into it. You are spot on. Tests don't fail when run individually but if all the tests are run then 149 of those fail. I digged into it and figured out that there is an bug in existing test code QTestUtil.java . I will upload the patch soon on HIVE-2589 which fixes this bug. All the tests pass with that patch. Fix flaky testing infrastructure - Key: HIVE-2725 URL: https://issues.apache.org/jira/browse/HIVE-2725 Project: Hive Issue Type: Bug Components: Testing Infrastructure Affects Versions: 0.9.0 Reporter: Ashutosh Chauhan To begin with org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert2_overwrite_partitions and org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_inputddl5 are failing on trunk for a while now. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2589) Newly created partition should inherit properties from table
[ https://issues.apache.org/jira/browse/HIVE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2589: --- Attachment: hive-2589_3.patch Same patch as HIVE-2589_2.patch with bug fix in QTestUtil.java which makes all the tests pass. Newly created partition should inherit properties from table Key: HIVE-2589 URL: https://issues.apache.org/jira/browse/HIVE-2589 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.1, 0.9.0 Attachments: hive-2589.patch, hive-2589.patch, hive-2589_1.patch, hive-2589_2.patch, hive-2589_3.patch This will make all the info contained in table properties available to partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2589) Newly created partition should inherit properties from table
[ https://issues.apache.org/jira/browse/HIVE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2589: --- Attachment: hive-2589_4.patch Missed few files. Newly created partition should inherit properties from table Key: HIVE-2589 URL: https://issues.apache.org/jira/browse/HIVE-2589 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.1, 0.9.0 Attachments: hive-2589.patch, hive-2589.patch, hive-2589_1.patch, hive-2589_2.patch, hive-2589_3.patch, hive-2589_4.patch This will make all the info contained in table properties available to partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2589) Newly created partition should inherit properties from table
[ https://issues.apache.org/jira/browse/HIVE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2589: --- Status: Patch Available (was: Reopened) Ready for review. Tests passed on my local machine. Newly created partition should inherit properties from table Key: HIVE-2589 URL: https://issues.apache.org/jira/browse/HIVE-2589 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.1, 0.9.0 Attachments: hive-2589.patch, hive-2589.patch, hive-2589_1.patch, hive-2589_2.patch, hive-2589_3.patch, hive-2589_4.patch This will make all the info contained in table properties available to partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2674) get_partitions_ps throws TApplicationException if table doesn't exist
[ https://issues.apache.org/jira/browse/HIVE-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2674: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin get_partitions_ps throws TApplicationException if table doesn't exist - Key: HIVE-2674 URL: https://issues.apache.org/jira/browse/HIVE-2674 Project: Hive Issue Type: Bug Components: Metastore Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2674.D987.1.patch, HIVE-2674.D987.2.patch If the table passed to get_partition_ps doesn't exist, a NPE is thrown by getPartitionPsQueryResults. There should be a check here, which throws a NoSuchObjectException if the table doesn't exist. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2727) add a testcase for partitioned view on union and base tables have index
[ https://issues.apache.org/jira/browse/HIVE-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190015#comment-13190015 ] Phabricator commented on HIVE-2727: --- njain has commented on the revision HIVE-2727 [jira] add a testcase for partitioned view on union and base tables have index. INLINE COMMENTS ql/src/test/results/clientpositive/union_view.q.out:2126 I am not sure - is this correct. Why are we doing a index scan for this table ? I mean src_union_3. We are only looking for index for src_union_1, which is correct. Let us talk offline REVISION DETAIL https://reviews.facebook.net/D1323 add a testcase for partitioned view on union and base tables have index --- Key: HIVE-2727 URL: https://issues.apache.org/jira/browse/HIVE-2727 Project: Hive Issue Type: Test Reporter: He Yongqiang Assignee: He Yongqiang Attachments: HIVE-2727.1.patch, HIVE-2727.D1323.1.patch, HIVE-2727.D1323.2.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2589) Newly created partition should inherit properties from table
[ https://issues.apache.org/jira/browse/HIVE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190022#comment-13190022 ] Phabricator commented on HIVE-2589: --- cwsteinbach has requested changes to the revision HIVE-2589 [jira] Newly created partition should inherit properties from table. INLINE COMMENTS metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java:1574 The description in hive-default.xml.template should mention that '*' denotes that all table properties will be inherited by new partitions. metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java:1569 Please add a comment at the beginning of this block: // Inherit table properties ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java:363 Thanks for tracking this down! common/src/java/org/apache/hadoop/hive/conf/HiveConf.java:122 I'm not sure this belongs here. Do you really want the metastore to get reinitialized every time someone resets this configuration property? ql/src/test/queries/clientpositive/part_inherit_tbl_props_empty.q:1 Explicitly set the configuration property to just to make things clear. REVISION DETAIL https://reviews.facebook.net/D1335 Newly created partition should inherit properties from table Key: HIVE-2589 URL: https://issues.apache.org/jira/browse/HIVE-2589 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.1, 0.9.0 Attachments: HIVE-2589.D1335.1.patch, hive-2589.patch, hive-2589.patch, hive-2589_1.patch, hive-2589_2.patch, hive-2589_3.patch, hive-2589_4.patch This will make all the info contained in table properties available to partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2720) Merge MetaStoreListener and HiveMetaHook interfaces
[ https://issues.apache.org/jira/browse/HIVE-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190035#comment-13190035 ] Phabricator commented on HIVE-2720: --- enis has commented on the revision HIVE-2720 [jira] Merge MetaStoreListener and HiveMetaHook interfaces. The patch as it is, does not change the event listener calling semantics or hivemetahook calling semantics. For something like an audit log, the order for the registered hooks become really important, and it should indeed be the first registered hook. That was one of the reasons that the HiveMetaStore.getDefaultHooks() precede all the user-defined hooks. As you suggested we can add transactional semantics to the hook interface, but I guess that would require exposing startTransaction, rollback and commit interfaces, and implementing something like a two phase commit to make sure to keep consistency with the external data. Without it, I don't think we can implement correct behavior. Having said that, I am very reluctant to go that way until some real need arises. So what I propose we can do is: - Keep the HiveMetaHook as it is in trunk and HiveMetaStoreClient. - introduce HiveExtendedMetaHook interface to limited private to replace HiveMetaStoreEventListener, and allow only hive and hcat implementations (by documenting it). We guarantee correct behavior by carefully ordering the hooks. - Keep the current semantics as in the patch, but improve on the javadoc for the method semantics. Would that work, what do you think? INLINE COMMENTS metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreEventListener.java:105 Renaming methods from onXXX - postXX makes sense. The MetaStoreEventListener's can interact with the function execution by throwing exceptions, or can act differently on the outcome of the method call (like the HbaseStorageHandler). We can rename MetaStoreEventListener to MetaStoreHook, or else, we can re-purpose HiveMetaHook, and deprecate MetaStoreEventListener instead. Wdyt, any other suggestions? I'll update the patch shortly. metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreEventListener.java:199 I'll update the patch to add all the method hooks. metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaHook.java:66 The patch as it is, does not change the event listener calling semantics or hivemetahook calling semantics. For something like an audit log, the order for the registered hooks become really important, and it should indeed be the first registered hook. That was one of the reasons that the HiveMetaStore.getDefaultHooks() precede all the user-defined hooks. As you suggested we can add transactional semantics to the hook interface, but I guess that would require exposing startTransaction, rollback and commit interfaces, and implementing something like a two phase commit to make sure to keep consistency with the external data. Without it, I don't think we can implement correct behavior. Having said that, I am very reluctant to go that way until some real need arises. So what I propose we can do is: - Keep the HiveMetaHook as it is in trunk and HiveMetaStoreClient. - introduce HiveExtendedMetaHook interface to limited private to replace HiveMetaStoreEventListener, and allow only hive and hcat implementations (by documenting it). We guarantee correct behavior by carefully ordering the hooks. - Keep the current semantics as in the patch, but improve on the javadoc for the method semantics. Would that work, what do you think? REVISION DETAIL https://reviews.facebook.net/D1299 Merge MetaStoreListener and HiveMetaHook interfaces --- Key: HIVE-2720 URL: https://issues.apache.org/jira/browse/HIVE-2720 Project: Hive Issue Type: Sub-task Components: JDBC, Metastore, ODBC, Security Reporter: Enis Soztutar Assignee: Enis Soztutar Attachments: HIVE-2720.D1299.1.patch, HIVE-2720.D1299.2.patch, HIVE-2720.D1299.3.patch MetaStoreListener and HiveMetaHook both serve as a notification mechanism for metastore-related events. The former is used by hcat and the latter is by the hbase-storage handler, and invoked by the client. I propose to merge these interfaces, and extend the MetaStoreListener, to add most of the on- and pre- methods at the Thrift interface. This way, extending metastore will be easier, and validation, storage-driver notification, and enforcement can be delegated to individual listeners. Besides, more functionality can be plugged-in by Hcat at this level. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
[jira] [Commented] (HIVE-2589) Newly created partition should inherit properties from table
[ https://issues.apache.org/jira/browse/HIVE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190042#comment-13190042 ] Phabricator commented on HIVE-2589: --- ashutoshc has commented on the revision HIVE-2589 [jira] Newly created partition should inherit properties from table. INLINE COMMENTS common/src/java/org/apache/hadoop/hive/conf/HiveConf.java:122 Yeah, if someone is changing this key, metastore should get reinitialized with new value for that session. Tests also fail if I take it out from here. metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java:1569 Will do so. metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java:1574 Will do so. ql/src/test/queries/clientpositive/part_inherit_tbl_props_empty.q:1 Will do so. REVISION DETAIL https://reviews.facebook.net/D1335 Newly created partition should inherit properties from table Key: HIVE-2589 URL: https://issues.apache.org/jira/browse/HIVE-2589 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.1, 0.9.0 Attachments: HIVE-2589.D1335.1.patch, hive-2589.patch, hive-2589.patch, hive-2589_1.patch, hive-2589_2.patch, hive-2589_3.patch, hive-2589_4.patch This will make all the info contained in table properties available to partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2589) Newly created partition should inherit properties from table
[ https://issues.apache.org/jira/browse/HIVE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2589: -- Attachment: HIVE-2589.D1335.2.patch ashutoshc updated the revision HIVE-2589 [jira] Newly created partition should inherit properties from table. Reviewers: JIRA, cwsteinbach, heyongqiang, njain Addresses Carl's comments. REVISION DETAIL https://reviews.facebook.net/D1335 AFFECTED FILES conf/hive-default.xml.template metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java common/src/java/org/apache/hadoop/hive/conf/HiveConf.java ql/src/test/results/clientpositive/part_inherit_tbl_props.q.out ql/src/test/results/clientpositive/part_inherit_tbl_props_empty.q.out ql/src/test/results/clientpositive/part_inherit_tbl_props_with_star.q.out ql/src/test/org/apache/hadoop/hive/ql/QTestUtil.java ql/src/test/queries/clientpositive/part_inherit_tbl_props_with_star.q ql/src/test/queries/clientpositive/part_inherit_tbl_props.q ql/src/test/queries/clientpositive/part_inherit_tbl_props_empty.q Newly created partition should inherit properties from table Key: HIVE-2589 URL: https://issues.apache.org/jira/browse/HIVE-2589 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.1, 0.9.0 Attachments: HIVE-2589.D1335.1.patch, HIVE-2589.D1335.2.patch, hive-2589.patch, hive-2589.patch, hive-2589_1.patch, hive-2589_2.patch, hive-2589_3.patch, hive-2589_4.patch This will make all the info contained in table properties available to partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1209 - Still Failing
Changes for Build #1175 [hashutosh] HIVE-2681 : SUCESS is misspelled (jonchang via Ashutosh Chauhan) Changes for Build #1176 [hashutosh] HIVE-2616 : Passing user identity from metastore client to server in non-secure mode (Ashutosh Chauhan) Changes for Build #1177 Changes for Build #1178 Changes for Build #1179 Changes for Build #1180 Changes for Build #1181 Changes for Build #1182 [heyongqiang] HIVE-2621:Allow multiple group bys with the same input data and spray keys to be run on the same reducer. (Kevin via He Yongqiang) Changes for Build #1184 [namit] HIVE-2690 a bug in 'alter table concatenate' that causes filenames getting double url encoded (He Yongqiang via namit) Changes for Build #1185 Changes for Build #1186 Changes for Build #1187 Changes for Build #1188 Changes for Build #1189 Changes for Build #1190 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1191 [amareshwari] HIVE-2629. Reverting previous commit Changes for Build #1192 [heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars (Kevin Wilfong via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2706 The issue was that the current thread's classloader and the classloader in the conf differed due to the prehook updating only the current thread's classloader with new jars. Now, it updates both classloaders, fixing the issue. When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error. Test Plan: Verified it fixed the stack overflow error. Reviewers: JIRA, heyongqiang, njain Reviewed By: heyongqiang CC: heyongqiang Differential Revision: https://reviews.facebook.net/D1167 Changes for Build #1193 [hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it shouldn't (jghoman via hashutosh) Changes for Build #1194 Changes for Build #1195 [hashutosh] HIVE-2589: Newly created partition should inherit properties from table (Ashutosh Chauhan) [hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan) Changes for Build #1196 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1197 Changes for Build #1198 [namit] HIVE-2504 Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Chinna Rao Lalam via namit) [namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit) Changes for Build #1199 Changes for Build #1200 Changes for Build #1201 Changes for Build #1202 Changes for Build #1203 Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 2 tests failed. REGRESSION: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown Error Message: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. Stack Trace: junit.framework.AssertionFailedError: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. at junit.framework.Assert.fail(Assert.java:50) at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown(TestCliDriver.java:25903) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) FAILED: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_inputddl5 Error Message: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. Stack Trace:
[jira] [Commented] (HIVE-2589) Newly created partition should inherit properties from table
[ https://issues.apache.org/jira/browse/HIVE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190083#comment-13190083 ] Ashutosh Chauhan commented on HIVE-2589: Ran the tests on trunk. All passed except ppr_pushdown.q which always fails in my environment with or without this patch. It is also getting tracked at HIVE-2686. Will start test run on 0.8-branch now. Carl, can I commit there too ? Newly created partition should inherit properties from table Key: HIVE-2589 URL: https://issues.apache.org/jira/browse/HIVE-2589 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.1, 0.9.0 Attachments: HIVE-2589.D1335.1.patch, HIVE-2589.D1335.2.patch, hive-2589.patch, hive-2589.patch, hive-2589_1.patch, hive-2589_2.patch, hive-2589_3.patch, hive-2589_4.patch This will make all the info contained in table properties available to partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2279) Implement sort_array UDF
[ https://issues.apache.org/jira/browse/HIVE-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2279: - Summary: Implement sort_array UDF (was: Implement sort(array) UDF) Implement sort_array UDF Key: HIVE-2279 URL: https://issues.apache.org/jira/browse/HIVE-2279 Project: Hive Issue Type: New Feature Components: UDF Reporter: Carl Steinbach Assignee: Zhenxiao Luo Attachments: HIVE-2279.D1059.1.patch, HIVE-2279.D1101.1.patch, HIVE-2279.D1107.1.patch, HIVE-2279.D1125.1.patch, HIVE-2279.D1143.1.patch, HIVE-2279.D1143.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2279) Implement sort_array UDF
[ https://issues.apache.org/jira/browse/HIVE-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2279: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed to trunk. Thanks Zhenxiao! Implement sort_array UDF Key: HIVE-2279 URL: https://issues.apache.org/jira/browse/HIVE-2279 Project: Hive Issue Type: New Feature Components: UDF Reporter: Carl Steinbach Assignee: Zhenxiao Luo Attachments: HIVE-2279.D1059.1.patch, HIVE-2279.D1101.1.patch, HIVE-2279.D1107.1.patch, HIVE-2279.D1125.1.patch, HIVE-2279.D1143.1.patch, HIVE-2279.D1143.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2279) Implement sort_array UDF
[ https://issues.apache.org/jira/browse/HIVE-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2279: - Fix Version/s: 0.9.0 Implement sort_array UDF Key: HIVE-2279 URL: https://issues.apache.org/jira/browse/HIVE-2279 Project: Hive Issue Type: New Feature Components: UDF Reporter: Carl Steinbach Assignee: Zhenxiao Luo Fix For: 0.9.0 Attachments: HIVE-2279.D1059.1.patch, HIVE-2279.D1101.1.patch, HIVE-2279.D1107.1.patch, HIVE-2279.D1125.1.patch, HIVE-2279.D1143.1.patch, HIVE-2279.D1143.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2206) add a new optimizer for query correlation discovery and optimization
[ https://issues.apache.org/jira/browse/HIVE-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190147#comment-13190147 ] Kevin Wilfong commented on HIVE-2206: - I tried running explain select * from (select * from src distribute by key sort by key) a join src b on a.key = b.key; using HIVE-2206.8.r1224646.patch.txt and I get the following exception: FAILED: Hive Internal Error: java.lang.ClassCastException(org.apache.hadoop.hive.ql.exec.SelectOperator cannot be cast to org.apache.hadoop.hive.ql.exec.ReduceSinkOperator) java.lang.ClassCastException: org.apache.hadoop.hive.ql.exec.SelectOperator cannot be cast to org.apache.hadoop.hive.ql.exec.ReduceSinkOperator at org.apache.hadoop.hive.ql.optimizer.CorrelationOptimizer$CorrelationNodeProc.findPeerReduceSinkOperators(CorrelationOptimizer.java:256) at org.apache.hadoop.hive.ql.optimizer.CorrelationOptimizer$CorrelationNodeProc.process(CorrelationOptimizer.java:503) at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:89) at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:88) at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.java:125) at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:102) at org.apache.hadoop.hive.ql.optimizer.CorrelationOptimizer.transform(CorrelationOptimizer.java:193) at org.apache.hadoop.hive.ql.optimizer.Optimizer.optimize(Optimizer.java:100) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7384) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) at org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:50) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) add a new optimizer for query correlation discovery and optimization Key: HIVE-2206 URL: https://issues.apache.org/jira/browse/HIVE-2206 Project: Hive Issue Type: New Feature Reporter: He Yongqiang Assignee: Yin Huai Attachments: HIVE-2206.1.patch.txt, HIVE-2206.2.patch.txt, HIVE-2206.3.patch.txt, HIVE-2206.4.patch.txt, HIVE-2206.5-1.patch.txt, HIVE-2206.5.patch.txt, HIVE-2206.6.patch.txt, HIVE-2206.7.patch.txt, HIVE-2206.8.r1224646.patch.txt, YSmartPatchForHive.patch, testQueries.2.q reference: http://www.cse.ohio-state.edu/hpcs/WWW/HTML/publications/papers/TR-11-7.pdf -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2206) add a new optimizer for query correlation discovery and optimization
[ https://issues.apache.org/jira/browse/HIVE-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190151#comment-13190151 ] Kevin Wilfong commented on HIVE-2206: - Nevermind, sorry, it was the distribute by followed by sort by. add a new optimizer for query correlation discovery and optimization Key: HIVE-2206 URL: https://issues.apache.org/jira/browse/HIVE-2206 Project: Hive Issue Type: New Feature Reporter: He Yongqiang Assignee: Yin Huai Attachments: HIVE-2206.1.patch.txt, HIVE-2206.2.patch.txt, HIVE-2206.3.patch.txt, HIVE-2206.4.patch.txt, HIVE-2206.5-1.patch.txt, HIVE-2206.5.patch.txt, HIVE-2206.6.patch.txt, HIVE-2206.7.patch.txt, HIVE-2206.8.r1224646.patch.txt, YSmartPatchForHive.patch, testQueries.2.q reference: http://www.cse.ohio-state.edu/hpcs/WWW/HTML/publications/papers/TR-11-7.pdf -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2694) Add FORMAT UDF
[ https://issues.apache.org/jira/browse/HIVE-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2694: - Status: Open (was: Patch Available) Add FORMAT UDF -- Key: HIVE-2694 URL: https://issues.apache.org/jira/browse/HIVE-2694 Project: Hive Issue Type: New Feature Components: UDF Reporter: Carl Steinbach Assignee: Zhenxiao Luo Attachments: HIVE-2694.D1149.1.patch, HIVE-2694.D1149.2.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2694) Add FORMAT UDF
[
https://issues.apache.org/jira/browse/HIVE-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190162#comment-13190162
]
Phabricator commented on HIVE-2694:
---
cwsteinbach has requested changes to the revision HIVE-2694 [jira] Add FORMAT
UDF.
INLINE COMMENTS
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFFormatNumber.java:99
Cleaner to take advantage of fall-through here, e.g:
switch (..) {
case VOID:
case FLOAT:
case DOUBLE:
break;
default:
...
}
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFFormatNumber.java:114
Fall-through
ql/src/test/queries/clientpositive/udf_format_number.q:17 Please try
formatting Double.MAX_VALUE and Long.MAX_VALUE.
ql/src/test/queries/clientpositive/udf_format_number.q:23 Please try
formatting Double.MIN_VALUE and Long.MIN_VALUE.
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFFormatNumber.java:49
The MySQL docs describe this function as follows:
FORMAT(X,D)
Formats the number X to a format like '#,###,###.##', rounded to D decimal
places, and returns the result as a string. If D is 0, the result has no
decimal point or fractional part.
I think types in the current description (double, int) should be removed.
Also, please make it clear in the doc string that this is intended to
duplicated the functionality of MySQL's FORMAT UDF.
ql/src/test/results/clientnegative/udf_format_number_wrong3.q.out:1 Actually,
I think it's acceptable for the first argument to be an integer type. In that
case the digits to the right of the decimal point will always be zero. You can
double check how the FORMAT UDF behaves in MySQL if you doubt this.
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFFormatNumber.java:101
The integer types should also be acceptable. See my other comment below.
ql/src/test/queries/clientpositive/udf_format_number.q:9 Also try formatting
the values 0, 1, 12, 123, 1234
REVISION DETAIL
https://reviews.facebook.net/D1149
Add FORMAT UDF
--
Key: HIVE-2694
URL: https://issues.apache.org/jira/browse/HIVE-2694
Project: Hive
Issue Type: New Feature
Components: UDF
Reporter: Carl Steinbach
Assignee: Zhenxiao Luo
Attachments: HIVE-2694.D1149.1.patch, HIVE-2694.D1149.2.patch
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2206) add a new optimizer for query correlation discovery and optimization
[ https://issues.apache.org/jira/browse/HIVE-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190161#comment-13190161 ] Kevin Wilfong commented on HIVE-2206: - The above bug is a pre-existing issue with reduce sink reduplication. The following new exception is produced by the query: set hive.optimize.reducededuplication=false; explain select * from (select * from src distribute by key sort by key) a join src b on a.key = b.key; FAILED: Hive Internal Error: java.lang.ArrayIndexOutOfBoundsException(1) java.lang.ArrayIndexOutOfBoundsException: 1 at org.apache.hadoop.hive.ql.optimizer.CorrelationOptimizerUtils.createCorrelationCompositeReducesinkOperaotr(CorrelationOptimizerUtils.java:599) at org.apache.hadoop.hive.ql.optimizer.CorrelationOptimizerUtils.applyCorrelation(CorrelationOptimizerUtils.java:365) at org.apache.hadoop.hive.ql.optimizer.CorrelationOptimizer.transform(CorrelationOptimizer.java:198) at org.apache.hadoop.hive.ql.optimizer.Optimizer.optimize(Optimizer.java:100) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7384) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) at org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:50) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) add a new optimizer for query correlation discovery and optimization Key: HIVE-2206 URL: https://issues.apache.org/jira/browse/HIVE-2206 Project: Hive Issue Type: New Feature Reporter: He Yongqiang Assignee: Yin Huai Attachments: HIVE-2206.1.patch.txt, HIVE-2206.2.patch.txt, HIVE-2206.3.patch.txt, HIVE-2206.4.patch.txt, HIVE-2206.5-1.patch.txt, HIVE-2206.5.patch.txt, HIVE-2206.6.patch.txt, HIVE-2206.7.patch.txt, HIVE-2206.8.r1224646.patch.txt, YSmartPatchForHive.patch, testQueries.2.q reference: http://www.cse.ohio-state.edu/hpcs/WWW/HTML/publications/papers/TR-11-7.pdf -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2727) add a testcase for partitioned view on union and base tables have index
[ https://issues.apache.org/jira/browse/HIVE-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190176#comment-13190176 ] Phabricator commented on HIVE-2727: --- njain has commented on the revision HIVE-2727 [jira] add a testcase for partitioned view on union and base tables have index. INLINE COMMENTS ql/src/test/results/clientpositive/union_view.q.out:308 This needs to be masked or ignored from the diff comparison. This will always fail Can you check for all lastModifiedTime occurences ? ql/src/test/queries/clientpositive/union_view.q:34 needs a order by to make it deterministic ql/src/test/queries/clientpositive/union_view.q:35 same as above ql/src/test/queries/clientpositive/union_view.q:38 same as above (line 39 also) ql/src/test/queries/clientpositive/union_view.q:59 make this and next one ordered ql/src/test/queries/clientpositive/union_view.q:84 basically, there are multiple partitions for ds=2 and ds=3. Can you make this deterministic ? REVISION DETAIL https://reviews.facebook.net/D1323 add a testcase for partitioned view on union and base tables have index --- Key: HIVE-2727 URL: https://issues.apache.org/jira/browse/HIVE-2727 Project: Hive Issue Type: Test Reporter: He Yongqiang Assignee: He Yongqiang Attachments: HIVE-2727.1.patch, HIVE-2727.D1323.1.patch, HIVE-2727.D1323.2.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2698) Enable Hadoop-1.0.0 in Hive
[ https://issues.apache.org/jira/browse/HIVE-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated HIVE-2698: Attachment: HIVE-2698_v3.patch Uploading a new version of the patch. I removed the slf4j import, the jars from the hadoop-1.0.0 was being extracted in a different directory, which is why they were not included in the classpath. This patch adds those jars to the classpath, similar to what we do for .20.1 and .23 Enable Hadoop-1.0.0 in Hive --- Key: HIVE-2698 URL: https://issues.apache.org/jira/browse/HIVE-2698 Project: Hive Issue Type: New Feature Components: Security, Shims Affects Versions: 0.9.0 Reporter: Enis Soztutar Assignee: Enis Soztutar Attachments: HIVE-2698_v1.patch, HIVE-2698_v2.patch, HIVE-2698_v3.patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2698) Enable Hadoop-1.0.0 in Hive
[ https://issues.apache.org/jira/browse/HIVE-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar updated HIVE-2698: Labels: hadoop hadoop-1.0 jars (was: ) Status: Patch Available (was: Open) Enable Hadoop-1.0.0 in Hive --- Key: HIVE-2698 URL: https://issues.apache.org/jira/browse/HIVE-2698 Project: Hive Issue Type: New Feature Components: Security, Shims Affects Versions: 0.9.0 Reporter: Enis Soztutar Assignee: Enis Soztutar Labels: hadoop, jars, hadoop-1.0 Attachments: HIVE-2698_v1.patch, HIVE-2698_v2.patch, HIVE-2698_v3.patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2542) DROP DATABASE CASCADE does not drop non-native tables.
[ https://issues.apache.org/jira/browse/HIVE-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190195#comment-13190195 ] Ashutosh Chauhan commented on HIVE-2542: On the second thought, HiveMetaHook is defined per table and not on per db basis. So in dropDatabase() there is no hook to get. Different tables in a db will have different hooks. Approach you have make sense in current design. Can you create a phabricator review request for your patch. I will take a look. DROP DATABASE CASCADE does not drop non-native tables. --- Key: HIVE-2542 URL: https://issues.apache.org/jira/browse/HIVE-2542 Project: Hive Issue Type: Bug Components: Metastore Reporter: Vandana Ayyalasomayajula Assignee: Vandana Ayyalasomayajula Labels: handler, hive, metastore, storage Attachments: Hive-2542.patch The hive meta store client does not delete the non-native tables during the drop database dbname cascade operation. As a result even though the database is deleted the tables still exist. This is related to HCATALOG-144. A deeper look at the HiveMetaStoreClient's dropDatabase function, tells us that the function does not utilize the hive meta hooks of the tables in the database for dropping the non-native tables. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2542) DROP DATABASE CASCADE does not drop non-native tables.
[ https://issues.apache.org/jira/browse/HIVE-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190202#comment-13190202 ] Vandana Ayyalasomayajula commented on HIVE-2542: I have created a phabricator review request for the patch. DROP DATABASE CASCADE does not drop non-native tables. --- Key: HIVE-2542 URL: https://issues.apache.org/jira/browse/HIVE-2542 Project: Hive Issue Type: Bug Components: Metastore Reporter: Vandana Ayyalasomayajula Assignee: Vandana Ayyalasomayajula Labels: handler, hive, metastore, storage Attachments: Hive-2542.patch The hive meta store client does not delete the non-native tables during the drop database dbname cascade operation. As a result even though the database is deleted the tables still exist. This is related to HCATALOG-144. A deeper look at the HiveMetaStoreClient's dropDatabase function, tells us that the function does not utilize the hive meta hooks of the tables in the database for dropping the non-native tables. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2732) Reduce Sink deduplication fails if the child reduce sink is followed by a join
Reduce Sink deduplication fails if the child reduce sink is followed by a join -- Key: HIVE-2732 URL: https://issues.apache.org/jira/browse/HIVE-2732 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong set hive.optimize.reducededuplication=true; set hive.auto.convert.join=true; explain select * from (select * from src distribute by key sort by key) a join src b on a.key = b.key; fails with the following exception java.lang.ClassCastException: org.apache.hadoop.hive.ql.exec.SelectOperator cannot be cast to org.apache.hadoop.hive.ql.exec.ReduceSinkOperator at org.apache.hadoop.hive.ql.optimizer.MapJoinProcessor.convertMapJoin(MapJoinProcessor.java:313) at org.apache.hadoop.hive.ql.optimizer.MapJoinProcessor.genMapJoinOpAndLocalWork(MapJoinProcessor.java:226) at org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinResolver$CommonJoinTaskDispatcher.processCurrentTask(CommonJoinResolver.java:174) at org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinResolver$CommonJoinTaskDispatcher.dispatch(CommonJoinResolver.java:287) at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.dispatch(TaskGraphWalker.java:111) at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.walk(TaskGraphWalker.java:194) at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.startWalking(TaskGraphWalker.java:139) at org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinResolver.resolve(CommonJoinResolver.java:68) at org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer.optimize(PhysicalOptimizer.java:72) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genMapRedTasks(SemanticAnalyzer.java:7019) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7312) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) at org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:48) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) If hive.auto.convert.join is set to false, it produces an incorrect plan where the two halves of the join are processed in two separate map reduce tasks, and the reducers of these two tasks both contain the join operator resulting in an exception. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2542) DROP DATABASE CASCADE does not drop non-native tables.
[ https://issues.apache.org/jira/browse/HIVE-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190234#comment-13190234 ] Carl Steinbach commented on HIVE-2542: -- @Vandana: Do you have a link for the review request? Phabricator is supposed to automatically update the JIRA ticket. Did you forget to specify the JIRA ID when you ran arc? DROP DATABASE CASCADE does not drop non-native tables. --- Key: HIVE-2542 URL: https://issues.apache.org/jira/browse/HIVE-2542 Project: Hive Issue Type: Bug Components: Metastore Reporter: Vandana Ayyalasomayajula Assignee: Vandana Ayyalasomayajula Labels: handler, hive, metastore, storage Attachments: Hive-2542.patch The hive meta store client does not delete the non-native tables during the drop database dbname cascade operation. As a result even though the database is deleted the tables still exist. This is related to HCATALOG-144. A deeper look at the HiveMetaStoreClient's dropDatabase function, tells us that the function does not utilize the hive meta hooks of the tables in the database for dropping the non-native tables. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2674) get_partitions_ps throws TApplicationException if table doesn't exist
[ https://issues.apache.org/jira/browse/HIVE-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190236#comment-13190236 ] Hudson commented on HIVE-2674: -- Integrated in Hive-trunk-h0.21 #1210 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1210/]) HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1234065 Files : * /hive/trunk/metastore/if/hive_metastore.thrift * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp * /hive/trunk/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.h * /hive/trunk/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java * /hive/trunk/metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php * /hive/trunk/metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py * /hive/trunk/metastore/src/gen/thrift/gen-rb/thrift_hive_metastore.rb * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/IMetaStoreClient.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java * /hive/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java get_partitions_ps throws TApplicationException if table doesn't exist - Key: HIVE-2674 URL: https://issues.apache.org/jira/browse/HIVE-2674 Project: Hive Issue Type: Bug Components: Metastore Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2674.D987.1.patch, HIVE-2674.D987.2.patch If the table passed to get_partition_ps doesn't exist, a NPE is thrown by getPartitionPsQueryResults. There should be a check here, which throws a NoSuchObjectException if the table doesn't exist. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1210 - Still Failing
Changes for Build #1178 Changes for Build #1179 Changes for Build #1180 Changes for Build #1181 Changes for Build #1182 [heyongqiang] HIVE-2621:Allow multiple group bys with the same input data and spray keys to be run on the same reducer. (Kevin via He Yongqiang) Changes for Build #1184 [namit] HIVE-2690 a bug in 'alter table concatenate' that causes filenames getting double url encoded (He Yongqiang via namit) Changes for Build #1185 Changes for Build #1186 Changes for Build #1187 Changes for Build #1188 Changes for Build #1189 Changes for Build #1190 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1191 [amareshwari] HIVE-2629. Reverting previous commit Changes for Build #1192 [heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars (Kevin Wilfong via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2706 The issue was that the current thread's classloader and the classloader in the conf differed due to the prehook updating only the current thread's classloader with new jars. Now, it updates both classloaders, fixing the issue. When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error. Test Plan: Verified it fixed the stack overflow error. Reviewers: JIRA, heyongqiang, njain Reviewed By: heyongqiang CC: heyongqiang Differential Revision: https://reviews.facebook.net/D1167 Changes for Build #1193 [hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it shouldn't (jghoman via hashutosh) Changes for Build #1194 Changes for Build #1195 [hashutosh] HIVE-2589: Newly created partition should inherit properties from table (Ashutosh Chauhan) [hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan) Changes for Build #1196 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1197 Changes for Build #1198 [namit] HIVE-2504 Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Chinna Rao Lalam via namit) [namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit) Changes for Build #1199 Changes for Build #1200 Changes for Build #1201 Changes for Build #1202 Changes for Build #1203 Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 Changes for Build #1210 [namit] HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) 3 tests failed. REGRESSION: org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1 Error Message: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. Stack Trace: junit.framework.AssertionFailedError: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. at junit.framework.Assert.fail(Assert.java:50) at org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1(TestNegativeCliDriver.java:9480) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) FAILED: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown Error Message: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. Stack Trace: junit.framework.AssertionFailedError: Unexpected exception See
[jira] [Commented] (HIVE-2542) DROP DATABASE CASCADE does not drop non-native tables.
[ https://issues.apache.org/jira/browse/HIVE-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190245#comment-13190245 ] Vandana Ayyalasomayajula commented on HIVE-2542: Hey Carl, here is the link to the request: https://reviews.facebook.net/D1347 DROP DATABASE CASCADE does not drop non-native tables. --- Key: HIVE-2542 URL: https://issues.apache.org/jira/browse/HIVE-2542 Project: Hive Issue Type: Bug Components: Metastore Reporter: Vandana Ayyalasomayajula Assignee: Vandana Ayyalasomayajula Labels: handler, hive, metastore, storage Attachments: Hive-2542.patch The hive meta store client does not delete the non-native tables during the drop database dbname cascade operation. As a result even though the database is deleted the tables still exist. This is related to HCATALOG-144. A deeper look at the HiveMetaStoreClient's dropDatabase function, tells us that the function does not utilize the hive meta hooks of the tables in the database for dropping the non-native tables. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting
[ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190266#comment-13190266 ] Ashutosh Chauhan commented on HIVE-2665: I agree, something like this will be useful, since munging with HADOOP_OPTS can have undesired effects. Support for metastore service specific HADOOP_OPTS environment setting -- Key: HIVE-2665 URL: https://issues.apache.org/jira/browse/HIVE-2665 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Thomas Weise Assignee: Thomas Weise Priority: Minor For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2589) Newly created partition should inherit properties from table
[ https://issues.apache.org/jira/browse/HIVE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190271#comment-13190271 ] Ashutosh Chauhan commented on HIVE-2589: Committed to trunk. Newly created partition should inherit properties from table Key: HIVE-2589 URL: https://issues.apache.org/jira/browse/HIVE-2589 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.1, 0.9.0 Attachments: HIVE-2589.D1335.1.patch, HIVE-2589.D1335.2.patch, hive-2589.patch, hive-2589.patch, hive-2589_1.patch, hive-2589_2.patch, hive-2589_3.patch, hive-2589_4.patch This will make all the info contained in table properties available to partitions. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2206) add a new optimizer for query correlation discovery and optimization
[ https://issues.apache.org/jira/browse/HIVE-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190276#comment-13190276 ] Yin Huai commented on HIVE-2206: @Kevin, I will take a look at it. add a new optimizer for query correlation discovery and optimization Key: HIVE-2206 URL: https://issues.apache.org/jira/browse/HIVE-2206 Project: Hive Issue Type: New Feature Reporter: He Yongqiang Assignee: Yin Huai Attachments: HIVE-2206.1.patch.txt, HIVE-2206.2.patch.txt, HIVE-2206.3.patch.txt, HIVE-2206.4.patch.txt, HIVE-2206.5-1.patch.txt, HIVE-2206.5.patch.txt, HIVE-2206.6.patch.txt, HIVE-2206.7.patch.txt, HIVE-2206.8.r1224646.patch.txt, YSmartPatchForHive.patch, testQueries.2.q reference: http://www.cse.ohio-state.edu/hpcs/WWW/HTML/publications/papers/TR-11-7.pdf -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2733) PrimitiveObjectInspector.getPrimitiveCategory() returns DOUBLE for LONG MIN_VAUE(-9223372036854775808)
PrimitiveObjectInspector.getPrimitiveCategory() returns DOUBLE for LONG MIN_VAUE(-9223372036854775808) -- Key: HIVE-2733 URL: https://issues.apache.org/jira/browse/HIVE-2733 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2694) Add FORMAT UDF
[ https://issues.apache.org/jira/browse/HIVE-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2694: -- Attachment: HIVE-2694.D1149.3.patch zhenxiao updated the revision HIVE-2694 [jira] Add FORMAT UDF. Reviewers: JIRA, cwsteinbach HIVE-2694: Carl's comments addressed also accepts integer as X value to format add testcases for Long/Double boundary values currently using -9223372036854775807 as Long.MIN_VALUE Found a Hive bug, PrimitiveObjectInspector.getPrimitiveCategory() returns DOUBLE for Long.MIN_VALUE -9223372036854775808. HIVE-2733 is created to track this bug REVISION DETAIL https://reviews.facebook.net/D1149 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFFormatNumber.java ql/src/test/queries/clientnegative/udf_format_number_wrong1.q ql/src/test/queries/clientnegative/udf_format_number_wrong2.q ql/src/test/queries/clientnegative/udf_format_number_wrong3.q ql/src/test/queries/clientnegative/udf_format_number_wrong4.q ql/src/test/queries/clientnegative/udf_format_number_wrong5.q ql/src/test/queries/clientnegative/udf_format_number_wrong6.q ql/src/test/queries/clientnegative/udf_format_number_wrong7.q ql/src/test/queries/clientpositive/udf_format_number.q ql/src/test/results/clientnegative/udf_format_number_wrong1.q.out ql/src/test/results/clientnegative/udf_format_number_wrong2.q.out ql/src/test/results/clientnegative/udf_format_number_wrong3.q.out ql/src/test/results/clientnegative/udf_format_number_wrong4.q.out ql/src/test/results/clientnegative/udf_format_number_wrong5.q.out ql/src/test/results/clientnegative/udf_format_number_wrong6.q.out ql/src/test/results/clientnegative/udf_format_number_wrong7.q.out ql/src/test/results/clientpositive/show_functions.q.out ql/src/test/results/clientpositive/udf_format_number.q.out Add FORMAT UDF -- Key: HIVE-2694 URL: https://issues.apache.org/jira/browse/HIVE-2694 Project: Hive Issue Type: New Feature Components: UDF Reporter: Carl Steinbach Assignee: Zhenxiao Luo Attachments: HIVE-2694.D1149.1.patch, HIVE-2694.D1149.2.patch, HIVE-2694.D1149.3.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2694) Add FORMAT UDF
[ https://issues.apache.org/jira/browse/HIVE-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2694: --- Status: Patch Available (was: Open) Add FORMAT UDF -- Key: HIVE-2694 URL: https://issues.apache.org/jira/browse/HIVE-2694 Project: Hive Issue Type: New Feature Components: UDF Reporter: Carl Steinbach Assignee: Zhenxiao Luo Attachments: HIVE-2694.D1149.1.patch, HIVE-2694.D1149.2.patch, HIVE-2694.D1149.3.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2734) Fix some nondeterministic test output
Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2734: --- Description: Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2698) Enable Hadoop-1.0.0 in Hive
[
https://issues.apache.org/jira/browse/HIVE-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190302#comment-13190302
]
jack su commented on HIVE-2698:
---
I am not sure how to run the patch. I tried to run it as executable, I am
seeing:
~/hive-0.8.0$ ./HIVE-2698_v3.patch
diff: unrecognized option '--git'
diff: Try `diff --help' for more information.
./HIVE-2698_v3.patch: line 2: index: command not found
./HIVE-2698_v3.patch: line 3: ---: command not found
./HIVE-2698_v3.patch: line 4: +++: command not found
./HIVE-2698_v3.patch: line 5: @@: command not found
./HIVE-2698_v3.patch: line 6: syntax error near unexpected token `newline'
./HIVE-2698_v3.patch: line 6: ` pathelement
location=${hadoop.hdfs.jar}/'
This is my diff info:
diff -version
diff (GNU diffutils) 3.0
Copyright (C) 2010 Free Software Foundation, Inc.
Thanks.
Enable Hadoop-1.0.0 in Hive
---
Key: HIVE-2698
URL: https://issues.apache.org/jira/browse/HIVE-2698
Project: Hive
Issue Type: New Feature
Components: Security, Shims
Affects Versions: 0.9.0
Reporter: Enis Soztutar
Assignee: Enis Soztutar
Labels: hadoop, hadoop-1.0, jars
Attachments: HIVE-2698_v1.patch, HIVE-2698_v2.patch,
HIVE-2698_v3.patch
Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the
0.20S release.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2734: -- Attachment: HIVE-2734.D1359.1.patch zhenxiao requested code review of HIVE-2734 [jira] Fix some nondeterministic test output. Reviewers: JIRA HIVE-2734: Fix some nondeterministic test output Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D1359 AFFECTED FILES ql/src/test/queries/clientpositive/groupby1_limit.q ql/src/test/queries/clientpositive/input11_limit.q ql/src/test/queries/clientpositive/input1_limit.q ql/src/test/queries/clientpositive/input_lazyserde.q ql/src/test/queries/clientpositive/join18_multi_distinct.q ql/src/test/queries/clientpositive/join_1to1.q ql/src/test/queries/clientpositive/join_casesensitive.q ql/src/test/queries/clientpositive/join_filters.q ql/src/test/queries/clientpositive/join_nulls.q ql/src/test/queries/clientpositive/merge3.q ql/src/test/queries/clientpositive/metadataonly1.q ql/src/test/queries/clientpositive/rcfile_columnar.q ql/src/test/queries/clientpositive/rcfile_lazydecompress.q ql/src/test/queries/clientpositive/rcfile_union.q ql/src/test/queries/clientpositive/sample10.q ql/src/test/queries/clientpositive/udf_sentences.q ql/src/test/queries/clientpositive/union24.q ql/src/test/queries/clientpositive/virtual_column.q ql/src/test/results/clientpositive/groupby1_limit.q.out ql/src/test/results/clientpositive/input11_limit.q.out ql/src/test/results/clientpositive/input1_limit.q.out ql/src/test/results/clientpositive/input_lazyserde.q.out ql/src/test/results/clientpositive/join18_multi_distinct.q.out ql/src/test/results/clientpositive/join_1to1.q.out ql/src/test/results/clientpositive/join_casesensitive.q.out ql/src/test/results/clientpositive/join_filters.q.out ql/src/test/results/clientpositive/join_nulls.q.out ql/src/test/results/clientpositive/merge3.q.out ql/src/test/results/clientpositive/metadataonly1.q.out ql/src/test/results/clientpositive/rcfile_columnar.q.out ql/src/test/results/clientpositive/rcfile_lazydecompress.q.out ql/src/test/results/clientpositive/rcfile_union.q.out ql/src/test/results/clientpositive/sample10.q.out ql/src/test/results/clientpositive/udf_sentences.q.out ql/src/test/results/clientpositive/union24.q.out ql/src/test/results/clientpositive/virtual_column.q.out MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/2829/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2279) Implement sort_array UDF
[ https://issues.apache.org/jira/browse/HIVE-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190322#comment-13190322 ] Hudson commented on HIVE-2279: -- Integrated in Hive-trunk-h0.21 #1211 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1211/]) HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1234146 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFSortArray.java * /hive/trunk/ql/src/test/queries/clientnegative/udf_sort_array_wrong1.q * /hive/trunk/ql/src/test/queries/clientnegative/udf_sort_array_wrong2.q * /hive/trunk/ql/src/test/queries/clientnegative/udf_sort_array_wrong3.q * /hive/trunk/ql/src/test/queries/clientpositive/udf_sort_array.q * /hive/trunk/ql/src/test/results/clientnegative/udf_sort_array_wrong1.q.out * /hive/trunk/ql/src/test/results/clientnegative/udf_sort_array_wrong2.q.out * /hive/trunk/ql/src/test/results/clientnegative/udf_sort_array_wrong3.q.out * /hive/trunk/ql/src/test/results/clientpositive/show_functions.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_sort_array.q.out Implement sort_array UDF Key: HIVE-2279 URL: https://issues.apache.org/jira/browse/HIVE-2279 Project: Hive Issue Type: New Feature Components: UDF Reporter: Carl Steinbach Assignee: Zhenxiao Luo Fix For: 0.9.0 Attachments: HIVE-2279.D1059.1.patch, HIVE-2279.D1101.1.patch, HIVE-2279.D1107.1.patch, HIVE-2279.D1125.1.patch, HIVE-2279.D1143.1.patch, HIVE-2279.D1143.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2203) Extend concat_ws() UDF to support arrays of strings
[ https://issues.apache.org/jira/browse/HIVE-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190323#comment-13190323 ] Hudson commented on HIVE-2203: -- Integrated in Hive-trunk-h0.21 #1211 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1211/]) HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao Luo via cws) cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1234150 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFConcatWS.java * /hive/trunk/ql/src/test/queries/clientnegative/udf_concat_ws_wrong1.q * /hive/trunk/ql/src/test/queries/clientnegative/udf_concat_ws_wrong2.q * /hive/trunk/ql/src/test/queries/clientnegative/udf_concat_ws_wrong3.q * /hive/trunk/ql/src/test/queries/clientpositive/udf_concat_ws.q * /hive/trunk/ql/src/test/results/clientnegative/udf_concat_ws_wrong1.q.out * /hive/trunk/ql/src/test/results/clientnegative/udf_concat_ws_wrong2.q.out * /hive/trunk/ql/src/test/results/clientnegative/udf_concat_ws_wrong3.q.out * /hive/trunk/ql/src/test/results/clientpositive/udf_concat_ws.q.out Extend concat_ws() UDF to support arrays of strings --- Key: HIVE-2203 URL: https://issues.apache.org/jira/browse/HIVE-2203 Project: Hive Issue Type: Improvement Components: UDF Reporter: Carl Steinbach Assignee: Zhenxiao Luo Priority: Minor Fix For: 0.9.0 Attachments: HIVE-2203.D1065.1.patch, HIVE-2203.D1071.1.patch, HIVE-2203.D1113.1.patch, HIVE-2203.D1119.1.patch, HIVE-2203.D1137.1.patch, HIVE-2203.D1137.1.patch concat_ws() should support the following type of input parameters: concat_ws(string separator, arraystring) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1211 - Still Failing
Changes for Build #1178 Changes for Build #1179 Changes for Build #1180 Changes for Build #1181 Changes for Build #1182 [heyongqiang] HIVE-2621:Allow multiple group bys with the same input data and spray keys to be run on the same reducer. (Kevin via He Yongqiang) Changes for Build #1184 [namit] HIVE-2690 a bug in 'alter table concatenate' that causes filenames getting double url encoded (He Yongqiang via namit) Changes for Build #1185 Changes for Build #1186 Changes for Build #1187 Changes for Build #1188 Changes for Build #1189 Changes for Build #1190 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1191 [amareshwari] HIVE-2629. Reverting previous commit Changes for Build #1192 [heyongqiang] HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars (Kevin Wilfong via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2706 The issue was that the current thread's classloader and the classloader in the conf differed due to the prehook updating only the current thread's classloader with new jars. Now, it updates both classloaders, fixing the issue. When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error. Test Plan: Verified it fixed the stack overflow error. Reviewers: JIRA, heyongqiang, njain Reviewed By: heyongqiang CC: heyongqiang Differential Revision: https://reviews.facebook.net/D1167 Changes for Build #1193 [hashutosh] HIVE-2705: SemanticAnalyzer twice swallows an exception it shouldn't (jghoman via hashutosh) Changes for Build #1194 Changes for Build #1195 [hashutosh] HIVE-2589: Newly created partition should inherit properties from table (Ashutosh Chauhan) [hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan) Changes for Build #1196 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1197 Changes for Build #1198 [namit] HIVE-2504 Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Chinna Rao Lalam via namit) [namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit) Changes for Build #1199 Changes for Build #1200 Changes for Build #1201 Changes for Build #1202 Changes for Build #1203 Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 Changes for Build #1210 [namit] HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) Changes for Build #1211 [cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao Luo via cws) [cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws) 2 tests failed. FAILED: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown Error Message: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. Stack Trace: junit.framework.AssertionFailedError: Unexpected exception See build/ql/tmp/hive.log, or try ant test ... -Dtest.silent=false to get more logs. at junit.framework.Assert.fail(Assert.java:50) at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown(TestCliDriver.java:25904) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:243) at junit.framework.TestSuite.run(TestSuite.java:238) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) FAILED: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_inputddl5 Error Message: Unexpected exception See build/ql/tmp/hive.log, or try ant test ...
[jira] [Updated] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2734: -- Attachment: HIVE-2734.D1365.1.patch zhenxiao requested code review of HIVE-2734 [jira] Fix some nondeterministic test output. Reviewers: JIRA HIVE-2734: Fix some nondeterministic test output Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D1365 AFFECTED FILES ql/src/test/queries/clientpositive/groupby1_limit.q ql/src/test/queries/clientpositive/input11_limit.q ql/src/test/queries/clientpositive/input1_limit.q ql/src/test/queries/clientpositive/input_lazyserde.q ql/src/test/queries/clientpositive/join18_multi_distinct.q ql/src/test/queries/clientpositive/join_1to1.q ql/src/test/queries/clientpositive/join_casesensitive.q ql/src/test/queries/clientpositive/join_filters.q ql/src/test/queries/clientpositive/join_nulls.q ql/src/test/queries/clientpositive/merge3.q ql/src/test/queries/clientpositive/metadataonly1.q ql/src/test/queries/clientpositive/rcfile_columnar.q ql/src/test/queries/clientpositive/rcfile_lazydecompress.q ql/src/test/queries/clientpositive/rcfile_union.q ql/src/test/queries/clientpositive/sample10.q ql/src/test/queries/clientpositive/udf_sentences.q ql/src/test/queries/clientpositive/union24.q ql/src/test/queries/clientpositive/virtual_column.q ql/src/test/results/clientpositive/groupby1_limit.q.out ql/src/test/results/clientpositive/input11_limit.q.out ql/src/test/results/clientpositive/input1_limit.q.out ql/src/test/results/clientpositive/input_lazyserde.q.out ql/src/test/results/clientpositive/join18_multi_distinct.q.out ql/src/test/results/clientpositive/join_1to1.q.out ql/src/test/results/clientpositive/join_casesensitive.q.out ql/src/test/results/clientpositive/join_filters.q.out ql/src/test/results/clientpositive/join_nulls.q.out ql/src/test/results/clientpositive/merge3.q.out ql/src/test/results/clientpositive/metadataonly1.q.out ql/src/test/results/clientpositive/rcfile_columnar.q.out ql/src/test/results/clientpositive/rcfile_lazydecompress.q.out ql/src/test/results/clientpositive/rcfile_union.q.out ql/src/test/results/clientpositive/sample10.q.out ql/src/test/results/clientpositive/udf_sentences.q.out ql/src/test/results/clientpositive/union24.q.out ql/src/test/results/clientpositive/virtual_column.q.out MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/2835/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1365.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2734: --- Status: Patch Available (was: Open) Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1365.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190344#comment-13190344 ] Phabricator commented on HIVE-2734: --- zhenxiao has commented on the revision HIVE-2734 [jira] Fix some nondeterministic test output. This is the patch for apache/trunk REVISION DETAIL https://reviews.facebook.net/D1365 Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1365.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2734) Fix some nondeterministic test output
[ https://issues.apache.org/jira/browse/HIVE-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190343#comment-13190343 ] Phabricator commented on HIVE-2734: --- zhenxiao has commented on the revision HIVE-2734 [jira] Fix some nondeterministic test output. This is the patch for branch apache/branch-0.8-r2 REVISION DETAIL https://reviews.facebook.net/D1359 Fix some nondeterministic test output - Key: HIVE-2734 URL: https://issues.apache.org/jira/browse/HIVE-2734 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo Attachments: HIVE-2734.D1359.1.patch, HIVE-2734.D1365.1.patch Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 metadataonly1 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 virtual_column -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
