[jira] [Assigned] (HIVE-2789) When integrating into MapReduce2, 'select * from src distribute by src.key limit 1' returns non-deterministic result
[ https://issues.apache.org/jira/browse/HIVE-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reassigned HIVE-2789: Assignee: Carl Steinbach (was: Zhenxiao Luo) > When integrating into MapReduce2, 'select * from src distribute by src.key > limit 1' returns non-deterministic result > > > Key: HIVE-2789 > URL: https://issues.apache.org/jira/browse/HIVE-2789 > Project: Hive > Issue Type: Bug >Reporter: Zhenxiao Luo >Assignee: Carl Steinbach > > query_properties.q test failure: > [junit] Begin query: query_properties.q > [junit] 12/01/23 16:59:13 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:13 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:18 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:18 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:22 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:22 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:27 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:27 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:32 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:32 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:36 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:36 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:41 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:41 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:46 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:46 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:50 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:50 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:55 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:55 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 16:59:59 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 16:59:59 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 17:00:04 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 17:00:04 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 17:00:08 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 17:00:08 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 17:00:13 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 17:00:13 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 17:00:18 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 17:00:18 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/23 17:00:22 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/23 17:00:22 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapredu
Hive-trunk-h0.21 - Build # 1247 - Failure
Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 Changes for Build #1210 [namit] HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) Changes for Build #1211 [cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao Luo via cws) [cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws) Changes for Build #1212 [hashutosh] HIVE-2589 : Newly created partition should inherit properties from table (Ashutosh Chauhan) Changes for Build #1213 Changes for Build #1214 Changes for Build #1215 Changes for Build #1216 [cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws) Changes for Build #1217 Changes for Build #1218 Changes for Build #1219 [hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS environment setting (thw via hashutosh) Changes for Build #1220 [namit] HIVE-2727 add a testcase for partitioned view on union and base tables have index (He Yongqiang via namit) Changes for Build #1221 [hashutosh] HIVE-2746 : Metastore client doesn't log properly in case of connection failure to server (hashutosh) [cws] HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive (Enis Söztutar via Carl Steinbach) Summary: third version of the patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach CC: cwsteinbach, enis Differential Revision: https://reviews.facebook.net/D1389 Changes for Build #1222 [namit] HIVE-2750 Hive multi group by single reducer optimization causes invalid column reference error (Kevin Wilfong via namit) Changes for Build #1223 Changes for Build #1224 [cws] HIVE-2734 [jira] Fix some nondeterministic test output (Zhenxiao Luo via Carl Steinbach) Summary: HIVE-2734: Fix some nondeterministic test output Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach CC: zhenxiao, cwsteinbach Differential Revision: https://reviews.facebook.net/D1449 [namit] HIVE-2754 NPE in union with lateral view (Yongqiang He via namit) Changes for Build #1225 Changes for Build #1226 Changes for Build #1227 [namit] HIVE-2755 union follwowed by union_subq does not work if the subquery union has reducers (He Yongqiang via namit) Changes for Build #1228 Changes for Build #1229 [hashutosh] HIVE-2735: PlanUtils.configureTableJobPropertiesForStorageHandler() is not called for partitioned table (sushanth via ashutosh) Changes for Build #1230 [cws] HIVE-2760 [jira] TestCliDriver should log elapsed time Summary: HIVE-2760. TestCliDriver should log elapsed time Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc CC: ashutoshc, cwsteinbach Differential Revision: https://reviews.facebook.net/D1503 [cws] HIVE-2662 [jira] Add Ant configuration property for dumping classpath of tests Summary: HIVE-2662. Add Ant configuration property for dumping classpath of tests Test Plan: EMPTY Reviewers: JIRA, jsichi, ashutoshc Reviewed By: ashutoshc CC: ashutoshc Differential Revision: https://reviews.facebook.net/D903 Changes for Build #1231 [hashutosh] HIVE_2645: Hive Web Server startup messages logs incorrect path it is searching for WAR (Edward Capriolo via Ashutosh Chauhan) Changes for Build #1232 Changes for Build #1233 [sdong] HIVE-2249 When creating constant expression for numbers, try to infer type from another comparison operand, instead of trying to use integer first, and then long and double (Zhiqiu Kong via Siying Dong) Changes for Build #1234 Changes for Build #1235 [heyongqiang] HIVE-2765 hbase handler uses ZooKeeperConnectionException which is not compatible with HBase versions other than 0.89 (Pei Yue via He Yongqiang) Changes for Build #1236 Changes for Build #1237 Changes for Build #1238 [heyongqiang] HIVE-2772 [jira] make union31.q deterministic (Namit Jain via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2772 HIVE-2772 Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc CC: ashutoshc Differential Revision: https://reviews.facebook.net/D1557 [kevinwilfong] HIVE-2758 Metastore is caching too aggressively (Kevin Wilfong reviewed by Carl Steinbach) Changes for Build #1239 Changes for Build #1240 [namit] HIVE-2762 Alter Table Partition Concatenate Fails On Certain
[jira] [Commented] (HIVE-2779) Improve hooks run in Driver
[ https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203311#comment-13203311 ] Hudson commented on HIVE-2779: -- Integrated in Hive-trunk-h0.21 #1247 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1247/]) HIVE-2779 Improve Hooks run in Driver (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241729 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHook.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContext.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContextImpl.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyHooksRunInOrder.java * /hive/trunk/ql/src/test/queries/clientpositive/hook_order.q * /hive/trunk/ql/src/test/results/clientnegative/bad_exec_hooks.q.out * /hive/trunk/ql/src/test/results/clientpositive/hook_order.q.out > Improve hooks run in Driver > --- > > Key: HIVE-2779 > URL: https://issues.apache.org/jira/browse/HIVE-2779 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch, > HIVE-2779.D1599.3.patch > > > There are some small improvements that can be made to the hooks which are run > in the Driver: > 1) The code to get hooks has been clearly just been copy+pasted for each of > Pre/Post/OnFailure/SemanticAnalyzer hooks. This code should be consolidated > into a single method. > 2) There is a lot more information available to SemanticAnalyzer hooks which > ran after semantic analysis than to those that run before, such as inputs and > outputs. We should make some of this information available to those hooks, > preferably through HiveSemanticAnalyzerHookContext, so that existing hooks > aren't broken. > 3) Currently, possibly unintentionally, hooks are initialized and run in the > order they appear in the comma separated list that is the value of the > configuration variable. This is a useful property, we should add comments > indicating this is desired and add a unit test to enforce it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2784) Integrating with MapReduce2 get NPE throwed when executing a query with a "TABLESAMPLE(x percent)" clause
[ https://issues.apache.org/jira/browse/HIVE-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reassigned HIVE-2784: Assignee: Carl Steinbach > Integrating with MapReduce2 get NPE throwed when executing a query with a > "TABLESAMPLE(x percent)" clause > - > > Key: HIVE-2784 > URL: https://issues.apache.org/jira/browse/HIVE-2784 > Project: Hive > Issue Type: Bug >Reporter: Zhenxiao Luo >Assignee: Carl Steinbach > > the following TestCliDriver testcases fail: > sample_islocalmode_hook > split_sample > [junit] java.lang.NullPointerException > [junit] at > org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.sampleSplits(CombineHiveInputFormat.java:450) > [junit] at > org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:403) > [junit] at > org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:472) > [junit] at > org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:464) > [junit] at > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360) > [junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215) > [junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1212) > [junit] at java.security.AccessController.doPrivileged(Native Method) > [junit] at javax.security.auth.Subject.doAs(Subject.java:396) > [junit] at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) > [junit] at org.apache.hadoop.mapreduce.Job.submit(Job.java:1212) > [junit] at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:592) > [junit] at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:587) > [junit] at java.security.AccessController.doPrivileged(Native Method) > [junit] at javax.security.auth.Subject.doAs(Subject.java:396) > [junit] at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) > [junit] at > org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:587) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:452) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:710) > [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > [junit] at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > [junit] at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > [junit] at java.lang.reflect.Method.invoke(Method.java:597) > [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:200) > There are other qfiles which pass which use TABLESAMPLE without specifying a > percent -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2787) When integrating into MapReduce2, ALTER TABLE test ARCHIVE get invalid usage error
[ https://issues.apache.org/jira/browse/HIVE-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reassigned HIVE-2787: Assignee: (was: Carl Steinbach) > When integrating into MapReduce2, ALTER TABLE test ARCHIVE get invalid usage > error > -- > > Key: HIVE-2787 > URL: https://issues.apache.org/jira/browse/HIVE-2787 > Project: Hive > Issue Type: Bug >Reporter: Zhenxiao Luo > > [junit] Begin query: archive_multi.q > [junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] rmr: DEPRECATED: Please use 'rm -r' instead. > [junit] Deleted > /var/lib/hudson/workspace/CDH4-Hive-0.8.0/build/ql/test/data/warehouse/tstsrc > [junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] archive -archiveName NAME -p * > [junit] Invalid usage. > [junit] > [junit] Exception: Client Execution failed with error code = 9 > This affects the following TestCliDriver test cases: > archive > archive_multi > archive1 > archive_insert1 > archive_insert2 > archive_insert3 > archive_insert4 > archive_multi1 > archive_multi3 > archive_multi4 > archive_multi5 > archive_multi6 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2784) Integrating with MapReduce2 get NPE throwed when executing a query with a "TABLESAMPLE(x percent)" clause
[ https://issues.apache.org/jira/browse/HIVE-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reassigned HIVE-2784: Assignee: (was: Carl Steinbach) > Integrating with MapReduce2 get NPE throwed when executing a query with a > "TABLESAMPLE(x percent)" clause > - > > Key: HIVE-2784 > URL: https://issues.apache.org/jira/browse/HIVE-2784 > Project: Hive > Issue Type: Bug >Reporter: Zhenxiao Luo > > the following TestCliDriver testcases fail: > sample_islocalmode_hook > split_sample > [junit] java.lang.NullPointerException > [junit] at > org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.sampleSplits(CombineHiveInputFormat.java:450) > [junit] at > org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:403) > [junit] at > org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:472) > [junit] at > org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:464) > [junit] at > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360) > [junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215) > [junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1212) > [junit] at java.security.AccessController.doPrivileged(Native Method) > [junit] at javax.security.auth.Subject.doAs(Subject.java:396) > [junit] at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) > [junit] at org.apache.hadoop.mapreduce.Job.submit(Job.java:1212) > [junit] at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:592) > [junit] at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:587) > [junit] at java.security.AccessController.doPrivileged(Native Method) > [junit] at javax.security.auth.Subject.doAs(Subject.java:396) > [junit] at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) > [junit] at > org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:587) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:452) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:710) > [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > [junit] at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > [junit] at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > [junit] at java.lang.reflect.Method.invoke(Method.java:597) > [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:200) > There are other qfiles which pass which use TABLESAMPLE without specifying a > percent -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2791) filter is still removed due to regression of HIVE-1538 althougth HIVE-2344
[ https://issues.apache.org/jira/browse/HIVE-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] binlijin updated HIVE-2791: --- Attachment: HIVE-2791.patch > filter is still removed due to regression of HIVE-1538 althougth HIVE-2344 > -- > > Key: HIVE-2791 > URL: https://issues.apache.org/jira/browse/HIVE-2791 > Project: Hive > Issue Type: Bug >Reporter: binlijin > Attachments: HIVE-2791.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2791) filter is still removed due to regression of HIVE-1538 althougth HIVE-2344
filter is still removed due to regression of HIVE-1538 althougth HIVE-2344 -- Key: HIVE-2791 URL: https://issues.apache.org/jira/browse/HIVE-2791 Project: Hive Issue Type: Bug Reporter: binlijin -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2790) When integrating into MapReduce2, SELECT 'number' GROUP BY 'number' returns NULL
[
https://issues.apache.org/jira/browse/HIVE-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenxiao Luo updated HIVE-2790:
---
Summary: When integrating into MapReduce2, SELECT 'number' GROUP BY
'number' returns NULL (was: When integrating into MapReduce2, select 'number'
and select cast('number' as DOUBLE) returns NULL)
> When integrating into MapReduce2, SELECT 'number' GROUP BY 'number' returns
> NULL
>
>
> Key: HIVE-2790
> URL: https://issues.apache.org/jira/browse/HIVE-2790
> Project: Hive
> Issue Type: Bug
>Reporter: Zhenxiao Luo
>Assignee: Zhenxiao Luo
>
> Query result(-30.33) is missing in the running output:
> [junit] Begin query: groupby_neg_float.q
> [junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.system.dir is
> deprecated. Instead, use mapreduce.jobtracker.system.dir
> [junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.local.dir is
> deprecated. Instead, use mapreduce.cluster.local.dir
> [junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.system.dir is
> deprecated. Instead, use mapreduce.jobtracker.system.dir
> [junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.local.dir is
> deprecated. Instead, use mapreduce.cluster.local.dir
> [junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I
> lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime
> -I Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I
> java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I
> Caused by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]*
> more -I job_[0-9]*_[0-9]* -I USING 'java -cp
> /home/cloudera/Code/hive/build/ql/test/logs/clientpositive/groupby_neg_float.q.out
>
> /home/cloudera/Code/hive/ql/src/test/results/clientpositive/groupby_neg_float.q.out
> [junit] 14c14,15
> [junit] < POSTHOOK: Output:
> file:/tmp/cloudera/hive_2012-01-24_10-57-51_652_2049459353574360528/-mr-1
> [junit] —
> [junit] > POSTHOOK: Output:
> file:/data/users/njain/hive5/hive5/build/ql/tmp/815331462/1
> [junit] > -30.33
> [junit] 28c29,30
> [junit] < POSTHOOK: Output:
> file:/tmp/cloudera/hive_2012-01-24_10-57-56_909_7738265803221872068/-mr-1
> [junit] —
> [junit] > POSTHOOK: Output:
> file:/data/users/njain/hive5/hive5/build/ql/tmp/2082702070/1
> [junit] junit.framework.AssertionFailedError: Client execution results failed
> with error code = 1
> [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false"
> to get more logs.
> [junit] at junit.framework.Assert.fail(Assert.java:50)
> [junit] at
> org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_neg_float(TestCliDriver.java:129)
> [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit] at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> [junit] at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [junit] at java.lang.reflect.Method.invoke(Method.java:616)
> [junit] at junit.framework.TestCase.runTest(TestCase.java:168)
> [junit] at junit.framework.TestCase.runBare(TestCase.java:134)
> [junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
> [junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
> [junit] at junit.framework.TestResult.run(TestResult.java:113)
> [junit] at junit.framework.TestCase.run(TestCase.java:124)
> [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
> [junit] at junit.framework.TestSuite.run(TestSuite.java:238)
> [junit] at
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
> [junit] at
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
> [junit] at
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
> [junit] Exception: Client execution results failed with error code = 1
> [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false"
> to get more logs.
> [junit] > -30.33
> [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false"
> to get more logs.)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2790) When integrating into MapReduce2, select 'number' and select cast('number' as DOUBLE) returns NULL
When integrating into MapReduce2, select 'number' and select cast('number' as
DOUBLE) returns NULL
--
Key: HIVE-2790
URL: https://issues.apache.org/jira/browse/HIVE-2790
Project: Hive
Issue Type: Bug
Reporter: Zhenxiao Luo
Assignee: Zhenxiao Luo
Query result(-30.33) is missing in the running output:
[junit] Begin query: groupby_neg_float.q
[junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.system.dir is
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/24 10:57:53 WARN conf.Configuration: mapred.local.dir is
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.system.dir is
deprecated. Instead, use mapreduce.jobtracker.system.dir
[junit] 12/01/24 10:57:58 WARN conf.Configuration: mapred.local.dir is
deprecated. Instead, use mapreduce.cluster.local.dir
[junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I
lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime -I
Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I
java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I Caused
by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]* more -I
job_[0-9]*_[0-9]* -I USING 'java -cp
/home/cloudera/Code/hive/build/ql/test/logs/clientpositive/groupby_neg_float.q.out
/home/cloudera/Code/hive/ql/src/test/results/clientpositive/groupby_neg_float.q.out
[junit] 14c14,15
[junit] < POSTHOOK: Output:
file:/tmp/cloudera/hive_2012-01-24_10-57-51_652_2049459353574360528/-mr-1
[junit] —
[junit] > POSTHOOK: Output:
file:/data/users/njain/hive5/hive5/build/ql/tmp/815331462/1
[junit] > -30.33
[junit] 28c29,30
[junit] < POSTHOOK: Output:
file:/tmp/cloudera/hive_2012-01-24_10-57-56_909_7738265803221872068/-mr-1
[junit] —
[junit] > POSTHOOK: Output:
file:/data/users/njain/hive5/hive5/build/ql/tmp/2082702070/1
[junit] junit.framework.AssertionFailedError: Client execution results failed
with error code = 1
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to
get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_neg_float(TestCliDriver.java:129)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit] at java.lang.reflect.Method.invoke(Method.java:616)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
[junit] Exception: Client execution results failed with error code = 1
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to
get more logs.
[junit] > -30.33
[junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to
get more logs.)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2789) When integrating into MapReduce2, 'select * from src distribute by src.key limit 1' returns non-deterministic result
When integrating into MapReduce2, 'select * from src distribute by src.key limit 1' returns non-deterministic result Key: HIVE-2789 URL: https://issues.apache.org/jira/browse/HIVE-2789 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo query_properties.q test failure: [junit] Begin query: query_properties.q [junit] 12/01/23 16:59:13 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:13 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:18 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:18 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:22 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:22 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:27 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:27 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:32 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:32 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:36 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:36 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:41 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:41 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:46 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:46 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:50 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:50 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:55 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:55 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:59 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:59 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 17:00:04 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 17:00:04 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 17:00:08 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 17:00:08 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 17:00:13 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 17:00:13 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 17:00:18 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 17:00:18 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 17:00:22 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 17:00:22 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 17:00:27 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 17:00:27 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 17:00:31 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.d
[jira] [Created] (HIVE-2788) When integrating into MapReduce2, get wrong file exception in loading archive_corrupt.rc
When integrating into MapReduce2, get wrong file exception in loading archive_corrupt.rc Key: HIVE-2788 URL: https://issues.apache.org/jira/browse/HIVE-2788 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo archive_corrupt.q is failing due to file format exception when loading archive_corrupt.rc: [junit] Running org.apache.hadoop.hive.cli.TestCliDriver [junit] Begin query: archive_corrupt.q [junit] Copying file: file:/home/cloudera/Code/hive/data/files/archive_corrupt.rc [junit] Exception: Client Execution failed with error code = 9 [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. [junit] junit.framework.AssertionFailedError: Client Execution failed with error code = 9 [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. [junit] at junit.framework.Assert.fail(Assert.java:50) [junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_corrupt(TestCliDriver.java:109) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit] at java.lang.reflect.Method.invoke(Method.java:616) [junit] at junit.framework.TestCase.runTest(TestCase.java:168) [junit] at junit.framework.TestCase.runBare(TestCase.java:134) [junit] at junit.framework.TestResult$1.protect(TestResult.java:110) [junit] at junit.framework.TestResult.runProtected(TestResult.java:128) [junit] at junit.framework.TestResult.run(TestResult.java:113) [junit] at junit.framework.TestCase.run(TestCase.java:124) [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243) [junit] at junit.framework.TestSuite.run(TestSuite.java:238) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768) [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.) [junit] Cleaning up TestCliDriver [junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 6.778 sec [junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED [for] /home/cloudera/Code/hive/ql/build.xml: The following error occurred while executing this line: [for] /home/cloudera/Code/hive/build.xml:328: The following error occurred while executing this line: [for] /home/cloudera/Code/hive/build-common.xml:453: Tests failed! And, in /build/ql/test/logs/clientpositive/archive_corrupt.q.out: PREHOOK: query: drop table tstsrcpart PREHOOK: type: DROPTABLE POSTHOOK: query: drop table tstsrcpart POSTHOOK: type: DROPTABLE PREHOOK: query: create table tstsrcpart like srcpart PREHOOK: type: CREATETABLE POSTHOOK: query: create table tstsrcpart like srcpart POSTHOOK: type: CREATETABLE POSTHOOK: Output: default@tstsrcpart PREHOOK: query: load data local inpath '../data/files/archive_corrupt.rc' overwrite into table tstsrcpart partition (ds='2008-04-08', hr='11') PREHOOK: type: LOAD PREHOOK: Output: default@tstsrcpart Failed with exception Wrong file format. Please check the file's format. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2749) CONV returns incorrect results sometimes
[ https://issues.apache.org/jira/browse/HIVE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Chang updated HIVE-2749: - Attachment: HIVE-2749.D1437.2.patch > CONV returns incorrect results sometimes > > > Key: HIVE-2749 > URL: https://issues.apache.org/jira/browse/HIVE-2749 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang > Attachments: HIVE-2749.D1437.1.patch, HIVE-2749.D1437.2.patch, > HIVE-2749.D1437.2.patch > > > ...because it fails to reset state. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2726) COALESCE(NULL, NULL) NPEs
[ https://issues.apache.org/jira/browse/HIVE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Chang updated HIVE-2726: - Attachment: HIVE-2726.D1317.1.patch > COALESCE(NULL, NULL) NPEs > - > > Key: HIVE-2726 > URL: https://issues.apache.org/jira/browse/HIVE-2726 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang >Priority: Minor > Attachments: HIVE-2726.D1317.1.patch, HIVE-2726.D1317.1.patch > > > ReturnOIResolver returns null when it gets no non-void arguments. This is > bad. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2787) When integrating into MapReduce2, ALTER TABLE test ARCHIVE get invalid usage error
[ https://issues.apache.org/jira/browse/HIVE-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2787: --- Description: [junit] Begin query: archive_multi.q [junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] rmr: DEPRECATED: Please use 'rm -r' instead. [junit] Deleted /var/lib/hudson/workspace/CDH4-Hive-0.8.0/build/ql/test/data/warehouse/tstsrc [junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] archive -archiveName NAME -p * [junit] Invalid usage. [junit] [junit] Exception: Client Execution failed with error code = 9 This affects the following TestCliDriver test cases: archive archive_multi archive1 archive_insert1 archive_insert2 archive_insert3 archive_insert4 archive_multi1 archive_multi3 archive_multi4 archive_multi5 archive_multi6 > When integrating into MapReduce2, ALTER TABLE test ARCHIVE get invalid usage > error > -- > > Key: HIVE-2787 > URL: https://issues.apache.org/jira/browse/HIVE-2787 > Project: Hive > Issue Type: Bug >Reporter: Zhenxiao Luo >Assignee: Carl Steinbach > > [junit] Begin query: archive_multi.q > [junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:06 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] rmr: DEPRECATED: Please use 'rm -r' instead. > [junit] Deleted > /var/lib/hudson/workspace/CDH4-Hive-0.8.0/build/ql/test/data/warehouse/tstsrc > [junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:10 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:15 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:20 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:25 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.system.dir is > deprecated. Instead, use mapreduce.jobtracker.system.dir > [junit] 12/01/18 02:07:30 WARN conf.Configuration: mapred.local.dir is > deprecated. Instead, use mapreduce.cluster.local.dir > [junit] archive -archiveName NAME -p * > [junit] Invalid usage. > [junit] > [junit] Exception: Client Execution failed with error code = 9 > This affects the following TestCliDriver test cases: > archive > archive_multi > archive1 > archive_insert1 > archive_insert2 > archive_insert3 > archive_insert4 > archive_multi1 > archive_multi3 > archive_multi4 > archive_multi5 > archiv
[jira] [Created] (HIVE-2787) When integrating into MapReduce2, ALTER TABLE test ARCHIVE get invalid usage error
When integrating into MapReduce2, ALTER TABLE test ARCHIVE get invalid usage error -- Key: HIVE-2787 URL: https://issues.apache.org/jira/browse/HIVE-2787 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Carl Steinbach -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2786) Throw an error if the user tries to insert a table into a cluster other than the primary cluster
Throw an error if the user tries to insert a table into a cluster other than the primary cluster Key: HIVE-2786 URL: https://issues.apache.org/jira/browse/HIVE-2786 Project: Hive Issue Type: New Feature Reporter: Namit Jain By default, the user can only insert into the primary cluster. Add an option to insert into the secondary clusters also -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203200#comment-13203200 ] Kevin Wilfong commented on HIVE-2612: - I attached a patch which adds checks in the metastore so that, for now, now table or partition can be created or altered to have a primary cluster name other than the default, as specified by the config variable hive.default.cluster.name If the primary cluster name for a table or partition is not set, it defaults to that value as well. I also changed the name of hive.use.default.cluster to hive.use.input.primary.cluster to better convert it's meaning. > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.3.patch.txt, HIVE-2612.4.patch.txt, HIVE-2612.D1569.1.patch, > HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, > HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-2612: Attachment: HIVE-2612.4.patch.txt > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.3.patch.txt, HIVE-2612.4.patch.txt, HIVE-2612.D1569.1.patch, > HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, > HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2785) support use cluster
support use cluster --- Key: HIVE-2785 URL: https://issues.apache.org/jira/browse/HIVE-2785 Project: Hive Issue Type: New Feature Reporter: Namit Jain use cluster; use cluster ; should be supported -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2759) Change global_limit.q into linux format file
[ https://issues.apache.org/jira/browse/HIVE-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203180#comment-13203180 ] Phabricator commented on HIVE-2759: --- njain has accepted the revision "HIVE-2759 [jira] Change global_limit.q into linux format file". REVISION DETAIL https://reviews.facebook.net/D1497 > Change global_limit.q into linux format file > > > Key: HIVE-2759 > URL: https://issues.apache.org/jira/browse/HIVE-2759 > Project: Hive > Issue Type: Bug > Components: Testing Infrastructure >Reporter: Zhenxiao Luo >Assignee: Zhenxiao Luo > Attachments: HIVE-2759.D1497.1.patch, HIVE-2759.D1497.1.patch > > > global_limit.q is in dos format, and has "\ No newline at end of file". > Needs to be changed into linux format, removing all "^M" at the end of each > line. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Hive projects for Google Summer of code 2012 ?
Hi Namit Jain, I'm Alexis, I'm a master student, I'm studying in Cinvestav, df Mexico. I'm interesting in collaborating with Hive. I'd like to do my thesis work in something about Hive. I'd like to participate in Google Summer of Code 2012 too. The issues that you propose I find interesting, particularly in the next issues: * The topic 2. Indexed Joins. * [PO] Optimize Joins using Bloom Filters of this page https://cwiki.apache.org/confluence/display/Hive/Roadmap. Can you tell me something more about it? What is problem to be solved? What benefits we hope to gain? This because I want to raise my thesis problem. By another hand, can you be my mentor in Google Summer of Code, if I work with this topics? Thanks. El 5 de febrero de 2012 19:58, Namit Jain escribió: > Hi Alexis/Bharath, > > Great to see your interests. If you looking for ideas, some things that > will be very useful are: > > 1. Removing the map-join hint completely. > Moving all processing to runtime. > Currently, bucketed map joins and sort merge joins are completely > driven off hints. > It would be very helpful to the community, and also clean up the code a > lot. > > 2. Indexed Joins. > Something that would be really useful - > If the basic infrastructure is ready, it can eventually be used to join > tables > stored outside also (say Hbase). > > 3. Metastore understanding hierarchy. > For eg: if a table is partitioned by ds and hr, > A valid partition on ds does not exist. This is a very common usecase > on many > applications, and the current work-around is to have signal tables for > ds > un-necessarily complicating the process. > > > If you are interested, I would be happy to provide more details. > > > Thanks, > -namit > > > On 2/4/12 11:57 AM, "Ashutosh Chauhan" wrote: > > >Hi Alexis, > > > >Great to see your interest. Feel free to come up with concrete proposal > >and > >submit to GSoC. Its certainly heartening to see folks interested in making > >contributions to the Hive Project. > > > >Ashutosh > >On Sat, Feb 4, 2012 at 10:48, Alexis De La Cruz Toledo > >wrote: > > > >> Hi Ashutosh, I'm interesting in hive, > >> I'd like to improve the compilation process, > >> I have been that the plan query tree generated > >> by Hive can be optimized, and I'd like > >> to participate in Google Summer of code 2012. > >> What do you say? > >> > >> Regards. > >> > >> > >> El 4 de febrero de 2012 12:29, Ashutosh Chauhan >> >escribió: > >> > >> > Hey Bharath, > >> > > >> > Great to see your enthusiasm for Hive! I would be happy to mentor you > >>for > >> > the project. For the start, you can take a look at > >> > https://cwiki.apache.org/confluence/display/Hive/Roadmap for a list > of > >> > open > >> > projects in Hive. The document is bit dated, so some of those projects > >> may > >> > not be relevant. But, its a good source to start with to see if any of > >> > these projects excite you. > >> > > >> > Hope it helps, > >> > Ashutosh > >> > > >> > On Sat, Feb 4, 2012 at 08:47, bharath vissapragada < > >> > bharathvissapragada1...@gmail.com> wrote: > >> > > >> > > Hey list, devs, > >> > > > >> > > Google summer of code, 2012 's notification [1] has been released > >>and > >> > > mentoring organizations can submit their proposals to Google for > >> > opensource > >> > > projects. > >> > > > >> > > Any of the devs interested in mentoring students on Hive projects ( > >>any > >> > > critical jiras etc.) ? It would be great if any of the devs (dev > >>list > >> > > cc'ed) can do that on behalf of ASF . > >> > > > >> > > It would be a great opportunity for many students to contribute > >> patches > >> > > to Hadoop and Hive and make their summer vacation fruitful. > >> > > > >> > > [1] http://google-melange.appspot.com/gsoc/events/google/gsoc2012 > >> > > > >> > > Thanks and Regards, > >> > > Bharath .V > >> > > w:http://researchweb.iiit.ac.in/~bharath.v > >> > > > >> > > >> > >> > >> > >> -- > >> Ing. Alexis de la Cruz Toledo. > >> *Av. Instituto Politécnico Nacional No. 2508 Col. San Pedro Zacatenco. > >> México, > >> D.F, 07360 * > >> *CINVESTAV, DF.* > >> > > -- Ing. Alexis de la Cruz Toledo. *Av. Instituto Politécnico Nacional No. 2508 Col. San Pedro Zacatenco. México, D.F, 07360 * *CINVESTAV, DF.*
[jira] [Commented] (HIVE-2749) CONV returns incorrect results sometimes
[ https://issues.apache.org/jira/browse/HIVE-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203172#comment-13203172 ] Phabricator commented on HIVE-2749: --- njain has accepted the revision "HIVE-2749 [jira] CONV returns incorrect results sometimes". REVISION DETAIL https://reviews.facebook.net/D1437 > CONV returns incorrect results sometimes > > > Key: HIVE-2749 > URL: https://issues.apache.org/jira/browse/HIVE-2749 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang > Attachments: HIVE-2749.D1437.1.patch, HIVE-2749.D1437.2.patch > > > ...because it fails to reset state. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2774) Message when trying to create a view from a view should give name of offending view
[
https://issues.apache.org/jira/browse/HIVE-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-2774:
-
Status: Open (was: Patch Available)
> Message when trying to create a view from a view should give name of
> offending view
> ---
>
> Key: HIVE-2774
> URL: https://issues.apache.org/jira/browse/HIVE-2774
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
>Affects Versions: 0.7.1
>Reporter: Jakob Homan
>Assignee: Jakob Homan
> Fix For: 0.9.0
>
> Attachments: HIVE-2774.patch
>
>
> Currently when trying to create a view that contains another view (a
> prohibited operation) the exception is:
> {noformat}FAILED: Error in semantic analysis: Invalid Table Alias Referencing
> view from foreign databases is not supported.{noformat}
> 'Twould be better if this message included the view that caused the error so
> that when building views from lots of tables, one doesn't need to hunt to
> figure out which one was the actual view.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2774) Message when trying to create a view from a view should give name of offending view
[
https://issues.apache.org/jira/browse/HIVE-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203167#comment-13203167
]
Namit Jain commented on HIVE-2774:
--
Can you add a negative test ?
Look at ql/src/test/queries/clientnegative for an example ?
> Message when trying to create a view from a view should give name of
> offending view
> ---
>
> Key: HIVE-2774
> URL: https://issues.apache.org/jira/browse/HIVE-2774
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
>Affects Versions: 0.7.1
>Reporter: Jakob Homan
>Assignee: Jakob Homan
> Fix For: 0.9.0
>
> Attachments: HIVE-2774.patch
>
>
> Currently when trying to create a view that contains another view (a
> prohibited operation) the exception is:
> {noformat}FAILED: Error in semantic analysis: Invalid Table Alias Referencing
> view from foreign databases is not supported.{noformat}
> 'Twould be better if this message included the view that caused the error so
> that when building views from lots of tables, one doesn't need to hunt to
> figure out which one was the actual view.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2726) COALESCE(NULL, NULL) NPEs
[ https://issues.apache.org/jira/browse/HIVE-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203165#comment-13203165 ] Phabricator commented on HIVE-2726: --- njain has accepted the revision "HIVE-2726 [jira] COALESCE(NULL, NULL) NPEs". running tests REVISION DETAIL https://reviews.facebook.net/D1317 > COALESCE(NULL, NULL) NPEs > - > > Key: HIVE-2726 > URL: https://issues.apache.org/jira/browse/HIVE-2726 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Chang >Assignee: Jonathan Chang >Priority: Minor > Attachments: HIVE-2726.D1317.1.patch > > > ReturnOIResolver returns null when it gets no non-void arguments. This is > bad. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2779) Improve hooks run in Driver
[ https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2779: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin > Improve hooks run in Driver > --- > > Key: HIVE-2779 > URL: https://issues.apache.org/jira/browse/HIVE-2779 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch, > HIVE-2779.D1599.3.patch > > > There are some small improvements that can be made to the hooks which are run > in the Driver: > 1) The code to get hooks has been clearly just been copy+pasted for each of > Pre/Post/OnFailure/SemanticAnalyzer hooks. This code should be consolidated > into a single method. > 2) There is a lot more information available to SemanticAnalyzer hooks which > ran after semantic analysis than to those that run before, such as inputs and > outputs. We should make some of this information available to those hooks, > preferably through HiveSemanticAnalyzerHookContext, so that existing hooks > aren't broken. > 3) Currently, possibly unintentionally, hooks are initialized and run in the > order they appear in the comma separated list that is the value of the > configuration variable. This is a useful property, we should add comments > indicating this is desired and add a unit test to enforce it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2372) java.io.IOException: error=7, Argument list too long
[
https://issues.apache.org/jira/browse/HIVE-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203105#comment-13203105
]
Siying Dong commented on HIVE-2372:
---
How about make it configurable? (though I hate to add more and more parameters.)
> java.io.IOException: error=7, Argument list too long
>
>
> Key: HIVE-2372
> URL: https://issues.apache.org/jira/browse/HIVE-2372
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
>Reporter: Sergey Tryuber
>Priority: Critical
> Attachments: HIVE-2372.1.patch.txt
>
>
> I execute a huge query on a table with a lot of 2-level partitions. There is
> a perl reducer in my query. Maps worked ok, but every reducer fails with the
> following exception:
> 2011-08-11 04:58:29,865 INFO org.apache.hadoop.hive.ql.exec.ScriptOperator:
> Executing [/usr/bin/perl, , ]
> 2011-08-11 04:58:29,866 INFO org.apache.hadoop.hive.ql.exec.ScriptOperator:
> tablename=null
> 2011-08-11 04:58:29,866 INFO org.apache.hadoop.hive.ql.exec.ScriptOperator:
> partname=null
> 2011-08-11 04:58:29,866 INFO org.apache.hadoop.hive.ql.exec.ScriptOperator:
> alias=null
> 2011-08-11 04:58:29,935 FATAL ExecReducer:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing row (tag=0)
> {"key":{"reducesinkkey0":129390185139228,"reducesinkkey1":"8AF163CA6F"},"value":{"_col0":"8AF163CA6F","_col1":"2011-07-27
>
> 22:48:52","_col2":129390185139228,"_col3":2006,"_col4":4100,"_col5":"10017388=6","_col6":1063,"_col7":"NULL","_col8":"address.com","_col9":"NULL","_col10":"NULL"},"alias":0}
> at
> org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:256)
> at
> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:468)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:416)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1115)
> at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Cannot
> initialize ScriptOperator
> at
> org.apache.hadoop.hive.ql.exec.ScriptOperator.processOp(ScriptOperator.java:320)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:744)
> at
> org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:744)
> at
> org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(ExtractOperator.java:45)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
> at
> org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:247)
> ... 7 more
> Caused by: java.io.IOException: Cannot run program "/usr/bin/perl":
> java.io.IOException: error=7, Argument list too long
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)
> at
> org.apache.hadoop.hive.ql.exec.ScriptOperator.processOp(ScriptOperator.java:279)
> ... 15 more
> Caused by: java.io.IOException: java.io.IOException: error=7, Argument list
> too long
> at java.lang.UNIXProcess.(UNIXProcess.java:148)
> at java.lang.ProcessImpl.start(ProcessImpl.java:65)
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
> ... 16 more
> It seems to me, I found the cause. ScriptOperator.java puts a lot of configs
> as environment variables to the child reduce process. One of variables is
> mapred.input.dir, which in my case more than 150KB. There are a huge amount
> of input directories in this variable. In short, the problem is that Linux
> (up to 2.6.23 kernel version) limits summary size of environment variables
> for child processes to 132KB. This problem could be solved by upgrading the
> kernel. But strings limitations still be 132KB per string in environment
> variable. So such huge variable doesn't work even on my home computer
> (2.6.32). You can read more information on
> (http://www.kernel.org/doc/man-pages/online/pages/man2/execve.2.html).
> For now all our work has been stopped because of this problem and I can't
> find the solution. The only solution, which seems to me more reasonable is to
> get rid of this variable in reducers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apac
[jira] [Commented] (HIVE-2784) Integrating with MapReduce2 get NPE throwed when executing a query with a "TABLESAMPLE(x percent)" clause
[ https://issues.apache.org/jira/browse/HIVE-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203100#comment-13203100 ] Navis commented on HIVE-2784: - If you are using hadoop-CDH version, it might be the same problem described by HIVE-2778. > Integrating with MapReduce2 get NPE throwed when executing a query with a > "TABLESAMPLE(x percent)" clause > - > > Key: HIVE-2784 > URL: https://issues.apache.org/jira/browse/HIVE-2784 > Project: Hive > Issue Type: Bug >Reporter: Zhenxiao Luo >Assignee: Carl Steinbach > > the following TestCliDriver testcases fail: > sample_islocalmode_hook > split_sample > [junit] java.lang.NullPointerException > [junit] at > org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.sampleSplits(CombineHiveInputFormat.java:450) > [junit] at > org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:403) > [junit] at > org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:472) > [junit] at > org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:464) > [junit] at > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360) > [junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215) > [junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1212) > [junit] at java.security.AccessController.doPrivileged(Native Method) > [junit] at javax.security.auth.Subject.doAs(Subject.java:396) > [junit] at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) > [junit] at org.apache.hadoop.mapreduce.Job.submit(Job.java:1212) > [junit] at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:592) > [junit] at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:587) > [junit] at java.security.AccessController.doPrivileged(Native Method) > [junit] at javax.security.auth.Subject.doAs(Subject.java:396) > [junit] at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) > [junit] at > org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:587) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:452) > [junit] at > org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:710) > [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > [junit] at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > [junit] at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > [junit] at java.lang.reflect.Method.invoke(Method.java:597) > [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:200) > There are other qfiles which pass which use TABLESAMPLE without specifying a > percent -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2784) Integrating with MapReduce2 get NPE throwed when executing a query with a "TABLESAMPLE(x percent)" clause
Integrating with MapReduce2 get NPE throwed when executing a query with a "TABLESAMPLE(x percent)" clause - Key: HIVE-2784 URL: https://issues.apache.org/jira/browse/HIVE-2784 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Carl Steinbach the following TestCliDriver testcases fail: sample_islocalmode_hook split_sample [junit] java.lang.NullPointerException [junit] at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.sampleSplits(CombineHiveInputFormat.java:450) [junit] at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:403) [junit] at org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:472) [junit] at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:464) [junit] at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360) [junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215) [junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1212) [junit] at java.security.AccessController.doPrivileged(Native Method) [junit] at javax.security.auth.Subject.doAs(Subject.java:396) [junit] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) [junit] at org.apache.hadoop.mapreduce.Job.submit(Job.java:1212) [junit] at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:592) [junit] at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:587) [junit] at java.security.AccessController.doPrivileged(Native Method) [junit] at javax.security.auth.Subject.doAs(Subject.java:396) [junit] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) [junit] at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:587) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:452) [junit] at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:710) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:597) [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:200) There are other qfiles which pass which use TABLESAMPLE without specifying a percent -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2783) Predicate Pushdown failure a view with union when using MapReduce2
Predicate Pushdown failure a view with union when using MapReduce2 -- Key: HIVE-2783 URL: https://issues.apache.org/jira/browse/HIVE-2783 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo ppd_union_view failure: [junit] Begin query: ppd_union_view.q [junit] 12/01/23 16:57:30 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:57:30 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:57:37 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:57:37 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:57:44 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:57:44 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:57:51 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:57:51 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:57:57 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:57:57 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:04 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:04 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:11 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:11 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:16 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:16 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:21 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:21 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:26 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:26 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:31 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:31 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:35 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:35 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:41 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:41 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:46 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:46 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:50 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:50 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:58:55 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:58:55 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:00 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:00 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] 12/01/23 16:59:04 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 16:59:04 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cl
[jira] [Assigned] (HIVE-1977) DESCRIBE TABLE syntax doesn't support specifying a database qualified table name
[
https://issues.apache.org/jira/browse/HIVE-1977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenxiao Luo reassigned HIVE-1977:
--
Assignee: Zhenxiao Luo
> DESCRIBE TABLE syntax doesn't support specifying a database qualified table
> name
>
>
> Key: HIVE-1977
> URL: https://issues.apache.org/jira/browse/HIVE-1977
> Project: Hive
> Issue Type: Bug
> Components: Query Processor, SQL
>Reporter: Carl Steinbach
>Assignee: Zhenxiao Luo
>
> The syntax for DESCRIBE is broken. It should be:
> {code}
> DESCRIBE [EXTENDED] [database DOT]table [column]
> {code}
> but is actually
> {code}
> DESCRIBE [EXTENDED] table[DOT col_name]
> {code}
> Ref: http://dev.mysql.com/doc/refman/5.0/en/describe.html
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2782) New BINARY type produces unexpected results with supported UDFS when using MapReduce2
New BINARY type produces unexpected results with supported UDFS when using MapReduce2 - Key: HIVE-2782 URL: https://issues.apache.org/jira/browse/HIVE-2782 Project: Hive Issue Type: Bug Reporter: Zhenxiao Luo Assignee: Zhenxiao Luo When using MapReduce2 for Hive ba_table_udfs is failing with unexpected output: [junit] Begin query: ba_table_udfs.q [junit] 12/01/23 13:32:28 WARN conf.Configuration: mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir [junit] 12/01/23 13:32:28 WARN conf.Configuration: mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir [junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I lastUpdateTime -I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime -I Location -I LOCATION ' -I transient_lastDdlTime -I last_modified_ -I java.lang.RuntimeException -I at org -I at sun -I at java -I at junit -I Caused by: -I LOCK_QUERYID: -I LOCK_TIME: -I grantTime -I [.][.][.] [0-9]* more -I job_[0-9]*_[0-9]* -I USING 'java -cp /home/cloudera/Code/hive/build/ql/test/logs/clientpositive/ba_table_udfs.q.out /home/cloudera/Code/hive/ql/src/test/results/clientpositive/ba_table_udfs.q.out [junit] 20,26c20,26 [junit] < 2 10val_101 [junit] < 3 164val_164 1 [junit] < 3 150val_150 1 [junit] < 2 18val_181 [junit] < 3 177val_177 1 [junit] < 2 12val_121 [junit] < 2 11val_111 [junit] — [junit] > 3 120val_120 1 [junit] > 3 192val_192 1 [junit] > 3 119val_119 1 [junit] > 3 187val_187 1 [junit] > 3 176val_176 1 [junit] > 3 199val_199 1 [junit] > 3 118val_118 1 [junit] Exception: Client execution results failed with error code = 1 [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. [junit] junit.framework.AssertionFailedError: Client execution results failed with error code = 1 [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. [junit] at junit.framework.Assert.fail(Assert.java:50) [junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ba_table_udfs(TestCliDriver.java:129) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit] at java.lang.reflect.Method.invoke(Method.java:616) [junit] at junit.framework.TestCase.runTest(TestCase.java:168) [junit] at junit.framework.TestCase.runBare(TestCase.java:134) [junit] at junit.framework.TestResult$1.protect(TestResult.java:110) [junit] at junit.framework.TestResult.runProtected(TestResult.java:128) [junit] at junit.framework.TestResult.run(TestResult.java:113) [junit] at junit.framework.TestCase.run(TestCase.java:124) [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243) [junit] at junit.framework.TestSuite.run(TestSuite.java:238) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768) [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.) [junit] Cleaning up TestCliDriver [junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 10.751 sec [junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED [for] /home/cloudera/Code/hive/ql/build.xml: The following error occurred while executing this line: [for] /home/cloudera/Code/hive/build.xml:328: The following error occurred while executing this line: [for] /home/cloudera/Code/hive/build-common.xml:453: Tests failed! -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202935#comment-13202935 ] Kevin Wilfong commented on HIVE-2612: - I attached a patch which fixes an error seen where JDO was looking for a column which doesn't exist in the schema in the update scripts provided. The collection of MClusterStorageDescriptors was changed from a List to a Set, and a primary key was indicated in package.jdo. This fixes the error by removing the need to order the MClusterStorageDescriptors and providing a way to uniquely identify them. The primary key is already present in the upgrade scripts provided. > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.3.patch.txt, HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, > HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, > HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-2612: Attachment: HIVE-2612.3.patch.txt > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.3.patch.txt, HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, > HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, > HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2612: -- Attachment: HIVE-2612.D1569.7.patch njain updated the revision "HIVE-2612 [jira] support hive table/partitions coexistes in more than one clusters". Reviewers: JIRA REVISION DETAIL https://reviews.facebook.net/D1569 AFFECTED FILES conf/hive-default.xml.template metastore/scripts/upgrade/derby/010-HIVE-2612.derby.sql metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql metastore/scripts/upgrade/mysql/010-HIVE-2612.mysql.sql metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql metastore/scripts/upgrade/postgres/010-HIVE-2612.postgres.sql metastore/src/model/package.jdo metastore/src/model/org/apache/hadoop/hive/metastore/model/MStorageDescriptor.java metastore/src/model/org/apache/hadoop/hive/metastore/model/MClusterStorageDescriptor.java metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ClusterStorageDescriptor.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java metastore/src/gen/thrift/gen-php/hive_metastore_constants.php metastore/src/gen/thrift/gen-php/ThriftHiveMetastore.php metastore/src/gen/thrift/gen-php/hive_metastore_types.php metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php metastore/src/gen/thrift/gen-php/hive_metastore/hive_metastore_types.php metastore/if/hive_metastore.thrift common/src/java/org/apache/hadoop/hive/conf/HiveConf.java ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, > HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch, > HIVE-2612.D1569.7.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2781) HBaseSerDe should allow users to specify the timestamp passed to Puts
[ https://issues.apache.org/jira/browse/HIVE-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francis Liu updated HIVE-2781: -- Description: Users may want to specify the timestamp used for Put requests to hbase. Thus enabling users to have the same timestamp for a single batch of writes. Which would be useful for a number of things. HCatalog's HBase storageHandler implementation makes use of this feature to provide users with snapshot isolation and write transactions. My proposal is to add the timestamp option as a final static member: public static final long HBASE_PUT_TIMESTAMP = "hbase.put_timestamp" And passing this value to all the Puts created by serialize() Summary: HBaseSerDe should allow users to specify the timestamp passed to Puts (was: HBaseSerDe should allow users to specify the timestap to be used in Puts ) > HBaseSerDe should allow users to specify the timestamp passed to Puts > -- > > Key: HIVE-2781 > URL: https://issues.apache.org/jira/browse/HIVE-2781 > Project: Hive > Issue Type: Improvement >Reporter: Francis Liu > > Users may want to specify the timestamp used for Put requests to hbase. Thus > enabling users to have the same timestamp for a single batch of writes. Which > would be useful for a number of things. HCatalog's HBase storageHandler > implementation makes use of this feature to provide users with snapshot > isolation and write transactions. My proposal is to add the timestamp option > as a final static member: > public static final long HBASE_PUT_TIMESTAMP = "hbase.put_timestamp" > And passing this value to all the Puts created by serialize() -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2781) HBaseSerDe should allow users to specify the timestap to be used in Puts
HBaseSerDe should allow users to specify the timestap to be used in Puts - Key: HIVE-2781 URL: https://issues.apache.org/jira/browse/HIVE-2781 Project: Hive Issue Type: Improvement Reporter: Francis Liu -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2779) Improve hooks run in Driver
[ https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2779: -- Attachment: HIVE-2779.D1599.3.patch kevinwilfong updated the revision "HIVE-2779 [jira] Improve hooks run in Driver". Reviewers: JIRA, njain Updated the comments in HiveSemanticAnalyzerHookContext and HiveSemanticAnalyzerHookContextImpl to more explicitely say that the getInputs and getOutputs methods will only not return null if they are called after the update method is called, which should only be the case in the postAnalysis method of hooks. REVISION DETAIL https://reviews.facebook.net/D1599 AFFECTED FILES ql/src/test/results/clientnegative/bad_exec_hooks.q.out ql/src/test/results/clientpositive/hook_order.q.out ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifyHooksRunInOrder.java ql/src/test/queries/clientpositive/hook_order.q ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHook.java ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContext.java ql/src/java/org/apache/hadoop/hive/ql/parse/HiveSemanticAnalyzerHookContextImpl.java ql/src/java/org/apache/hadoop/hive/ql/Driver.java > Improve hooks run in Driver > --- > > Key: HIVE-2779 > URL: https://issues.apache.org/jira/browse/HIVE-2779 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch, > HIVE-2779.D1599.3.patch > > > There are some small improvements that can be made to the hooks which are run > in the Driver: > 1) The code to get hooks has been clearly just been copy+pasted for each of > Pre/Post/OnFailure/SemanticAnalyzer hooks. This code should be consolidated > into a single method. > 2) There is a lot more information available to SemanticAnalyzer hooks which > ran after semantic analysis than to those that run before, such as inputs and > outputs. We should make some of this information available to those hooks, > preferably through HiveSemanticAnalyzerHookContext, so that existing hooks > aren't broken. > 3) Currently, possibly unintentionally, hooks are initialized and run in the > order they appear in the comma separated list that is the value of the > configuration variable. This is a useful property, we should add comments > indicating this is desired and add a unit test to enforce it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202783#comment-13202783 ] Kevin Wilfong commented on HIVE-2612: - This change will require the user to update their metastore schema. The scripts in the patch should be sufficient provided the schema is already up to date. The only schema changes needed are a new table and a new column is added to SDS, it should not take long, no more than five minutes depending on the size of the SDS table, to update. > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, > HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202724#comment-13202724 ] Namit Jain commented on HIVE-2612: -- Can everyone concerned please take a look ? For anyone not using clusters, they need to run the scripts provided in this patch to upgrade the metastore. The time taken for the upgrade depends on the size of the metastore (number of tables/partitions), but it should be fairly small - it is less than 10 minutes for facebook cluster. > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, > HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202726#comment-13202726 ] Namit Jain commented on HIVE-2612: -- All the existing APIs will continue to work. > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, > HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2612: -- Attachment: HIVE-2612.D1569.6.patch njain updated the revision "HIVE-2612 [jira] support hive table/partitions coexistes in more than one clusters". Reviewers: JIRA REVISION DETAIL https://reviews.facebook.net/D1569 AFFECTED FILES conf/hive-default.xml.template metastore/scripts/upgrade/derby/010-HIVE-2612.derby.sql metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql metastore/scripts/upgrade/mysql/010-HIVE-2612.mysql.sql metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql metastore/scripts/upgrade/postgres/010-HIVE-2612.postgres.sql metastore/src/model/package.jdo metastore/src/model/org/apache/hadoop/hive/metastore/model/MStorageDescriptor.java metastore/src/model/org/apache/hadoop/hive/metastore/model/MClusterStorageDescriptor.java metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ClusterStorageDescriptor.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java metastore/src/gen/thrift/gen-php/hive_metastore_constants.php metastore/src/gen/thrift/gen-php/ThriftHiveMetastore.php metastore/src/gen/thrift/gen-php/hive_metastore_types.php metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php metastore/src/gen/thrift/gen-php/hive_metastore/hive_metastore_types.php metastore/if/hive_metastore.thrift common/src/java/org/apache/hadoop/hive/conf/HiveConf.java ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, > HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, HIVE-2612.D1569.6.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202719#comment-13202719 ] Kevin Wilfong commented on HIVE-2612: - I attached a patch to this JIRA which provides scripts to update the metastore for derby, MySQL and postgres. It also changes the default cluster name to '' (empty string) and fixes an inconsistency where the size of PRIMARY_CLUSTER_NAME in SDS had a different size than the CLUSTER_NAME column in CLUSTER_SDS. > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, > HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2612) support hive table/partitions coexistes in more than one clusters
[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-2612: Attachment: HIVE-2612.2.patch.txt > support hive table/partitions coexistes in more than one clusters > - > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore >Reporter: He Yongqiang >Assignee: Namit Jain > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, HIVE-2612.D1569.3.patch, > HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch > > > 1) add cluster object into hive metastore > 2) each partition/table has a creation cluster and a list of living clusters, > and also data location in each cluster -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2716) Move retry logic in HiveMetaStore to a separe class
[ https://issues.apache.org/jira/browse/HIVE-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202683#comment-13202683 ] Ashutosh Chauhan commented on HIVE-2716: @Enis, Patch has gone stale. Can you rebase it ? > Move retry logic in HiveMetaStore to a separe class > --- > > Key: HIVE-2716 > URL: https://issues.apache.org/jira/browse/HIVE-2716 > Project: Hive > Issue Type: Sub-task > Components: Metastore >Affects Versions: 0.9.0 >Reporter: Enis Soztutar >Assignee: Enis Soztutar > Attachments: HIVE-2716.D1227.1.patch > > > In HIVE-1219, method retrying for raw store operation are introduced to > handle jdo operations more robustly. However, the abstraction for the > RawStore operations can be moved to a separate class implementing RawStore, > which should clean up the code base for HiveMetaStore. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2779) Improve hooks run in Driver
[ https://issues.apache.org/jira/browse/HIVE-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202611#comment-13202611 ] Phabricator commented on HIVE-2779: --- njain has accepted the revision "HIVE-2779 [jira] Improve hooks run in Driver". Looks good - one minor comment. Can you add that all the inputs and outputs need not be populated in the semantic analyzer hook ? REVISION DETAIL https://reviews.facebook.net/D1599 > Improve hooks run in Driver > --- > > Key: HIVE-2779 > URL: https://issues.apache.org/jira/browse/HIVE-2779 > Project: Hive > Issue Type: Improvement >Reporter: Kevin Wilfong >Assignee: Kevin Wilfong > Attachments: HIVE-2779.D1599.1.patch, HIVE-2779.D1599.2.patch > > > There are some small improvements that can be made to the hooks which are run > in the Driver: > 1) The code to get hooks has been clearly just been copy+pasted for each of > Pre/Post/OnFailure/SemanticAnalyzer hooks. This code should be consolidated > into a single method. > 2) There is a lot more information available to SemanticAnalyzer hooks which > ran after semantic analysis than to those that run before, such as inputs and > outputs. We should make some of this information available to those hooks, > preferably through HiveSemanticAnalyzerHookContext, so that existing hooks > aren't broken. > 3) Currently, possibly unintentionally, hooks are initialized and run in the > order they appear in the comma separated list that is the value of the > configuration variable. This is a useful property, we should add comments > indicating this is desired and add a unit test to enforce it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
JDBC Driver support for multiple database/schema
Hello, While using the JDBC driver on 0.7.1, there seems to be an issue around support for multiple databases. According to Hive JDBC documentation at https://cwiki.apache.org/Hive/hiveclient.html : * * *"For standalone server, uri is "jdbc:hive://host:port/dbname" where host and port are determined by where the hive server is run. For example, "jdbc:hive://localhost:1/default". Currently, the only dbname supported is "default". *" Was there any specific reason to not support non-default databases? The obvious way for me to get it working is to patch the connection object, parse the connection string, pick the database name and issue a "USE " query as part of initializing the connection. Do you think this is a reasonable way to do this? Would be happy to have your suggestions! Thanks, Bharath
Get race condition in hive with script_pipe.q ( the same as HIVE-1491)
Hi,All I got the same error message described in [HIVE-1491] ( https://issues.apache.org/jira/browse/HIVE-1491) when ran script_pipe.q on Open JDK. Will hive plan to resolve this race condition? Details: = [junit] Begin query: script_pipe.q [junit] Ended Job = job_local_0001 with errors [junit] Error during job, obtaining debugging information... [junit] Exception: Client Execution failed with error code = 9 [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. [junit] junit.framework.AssertionFailedError: Client Execution failed with error code = 9 [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. [junit] at junit.framework.Assert.fail(Assert.java:50) [junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_script_pipe(TestCliDriver.java:27636) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37) [junit] at java.lang.reflect.Method.invoke(Method.java:611) [junit] at junit.framework.TestCase.runTest(TestCase.java:168) [junit] at junit.framework.TestCase.runBare(TestCase.java:134) [junit] at junit.framework.TestResult$1.protect(TestResult.java:110) [junit] at junit.framework.TestResult.runProtected(TestResult.java:128) [junit] at junit.framework.TestResult.run(TestResult.java:113) [junit] at junit.framework.TestCase.run(TestCase.java:124) [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243) [junit] at junit.framework.TestSuite.run(TestSuite.java:238) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) I tried to re-produce it: 1. create table src with two columns: key and value 2. run the following queries: SELECT TRANSFORM(key, value) USING 'head -n 1' FROM src;// PASS SELECT TRANSFORM(key, value) USING 'head -n 1' as a,b,c,d FROM src; //PASS SELECT TRANSFORM(key, value, key, value) USING 'head -n 1' FROM src; //PASS SELECT TRANSFORM(key, value, key, value) USING 'head -n 1' as a,b,c,d FROM src;//PASS SELECT TRANSFORM(key, value, key, value, key, value) USING 'head -n 1' FROM src;//FAILED SELECT TRANSFORM(key, value, key, value, key, value) USING 'head -n 1' as a,b,c,d FROM src;//FAILED Thanks, -- Bing
