Table not creating in hive
Hello all, After successfully importing the tables in hive I am not able to see the table in Hive. When I imported the table I saw the dir on HDFS (under /user/hive/warehouse/) but when I execute command in Hive SHOW TABLES the table is not in the list. I find a lot about it but not getting anything. Pls suggest me some solution for it. -- Thanks and Regards, Bhavesh Shah
Re: Table not creating in hive
This is because you need the metastore. If you aren't installed in a databases, it installed with derby in the directory when you access to hive, remember where was it. There you should find the directory name _metastore and in this directory access to hive. Regards. El 2 de febrero de 2012 05:46, Bhavesh Shah bhavesh25s...@gmail.comescribió: Hello all, After successfully importing the tables in hive I am not able to see the table in Hive. When I imported the table I saw the dir on HDFS (under /user/hive/warehouse/) but when I execute command in Hive SHOW TABLES the table is not in the list. I find a lot about it but not getting anything. Pls suggest me some solution for it. -- Thanks and Regards, Bhavesh Shah -- Ing. Alexis de la Cruz Toledo. *Av. Instituto Politécnico Nacional No. 2508 Col. San Pedro Zacatenco. México, D.F, 07360 * *CINVESTAV, DF.*
Hive-trunk-h0.21 - Build # 1239 - Still Failing
Changes for Build #1195 [hashutosh] HIVE-2589: Newly created partition should inherit properties from table (Ashutosh Chauhan) [hashutosh] HIVE-2682: Clean-up logs (Rajat Goel via Ashutosh Chauhan) Changes for Build #1196 [amareshwari] HIVE-2629. Make a single Hive binary work with both 0.20.x and 0.23.0. (Thomas Weise via amareshwari) Changes for Build #1197 Changes for Build #1198 [namit] HIVE-2504 Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Chinna Rao Lalam via namit) [namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit) Changes for Build #1199 Changes for Build #1200 Changes for Build #1201 Changes for Build #1202 Changes for Build #1203 Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 Changes for Build #1210 [namit] HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) Changes for Build #1211 [cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao Luo via cws) [cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws) Changes for Build #1212 [hashutosh] HIVE-2589 : Newly created partition should inherit properties from table (Ashutosh Chauhan) Changes for Build #1213 Changes for Build #1214 Changes for Build #1215 Changes for Build #1216 [cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws) Changes for Build #1217 Changes for Build #1218 Changes for Build #1219 [hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS environment setting (thw via hashutosh) Changes for Build #1220 [namit] HIVE-2727 add a testcase for partitioned view on union and base tables have index (He Yongqiang via namit) Changes for Build #1221 [hashutosh] HIVE-2746 : Metastore client doesn't log properly in case of connection failure to server (hashutosh) [cws] HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive (Enis Söztutar via Carl Steinbach) Summary: third version of the patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach CC: cwsteinbach, enis Differential Revision: https://reviews.facebook.net/D1389 Changes for Build #1222 [namit] HIVE-2750 Hive multi group by single reducer optimization causes invalid column reference error (Kevin Wilfong via namit) Changes for Build #1223 Changes for Build #1224 [cws] HIVE-2734 [jira] Fix some nondeterministic test output (Zhenxiao Luo via Carl Steinbach) Summary: HIVE-2734: Fix some nondeterministic test output Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach CC: zhenxiao, cwsteinbach Differential Revision: https://reviews.facebook.net/D1449 [namit] HIVE-2754 NPE in union with lateral view (Yongqiang He via namit) Changes for Build #1225 Changes for Build #1226 Changes for Build #1227 [namit] HIVE-2755 union follwowed by union_subq does not work if the subquery union has reducers (He Yongqiang via namit) Changes for Build #1228 Changes for Build #1229 [hashutosh] HIVE-2735: PlanUtils.configureTableJobPropertiesForStorageHandler() is not called for partitioned table (sushanth via ashutosh) Changes for Build #1230 [cws] HIVE-2760 [jira] TestCliDriver should log elapsed time Summary: HIVE-2760. TestCliDriver should log elapsed time Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc CC: ashutoshc, cwsteinbach Differential Revision: https://reviews.facebook.net/D1503 [cws] HIVE-2662 [jira] Add Ant configuration property for dumping classpath of tests Summary: HIVE-2662. Add Ant configuration property for dumping classpath of tests Test Plan: EMPTY Reviewers: JIRA, jsichi, ashutoshc Reviewed By: ashutoshc CC: ashutoshc Differential Revision: https://reviews.facebook.net/D903 Changes for Build #1231 [hashutosh] HIVE_2645: Hive Web Server startup messages logs incorrect path it is searching for WAR (Edward Capriolo via Ashutosh Chauhan) Changes for Build #1232 Changes for Build #1233 [sdong] HIVE-2249 When creating constant expression for numbers, try to infer type from another comparison operand, instead of trying to use integer first, and then long and double (Zhiqiu Kong via Siying Dong) Changes for Build #1234 Changes for Build #1235 [heyongqiang] HIVE-2765 hbase
[jira] [Updated] (HIVE-2756) Views should be added to the inputs of queries.
[ https://issues.apache.org/jira/browse/HIVE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wilfong updated HIVE-2756: Description: Views, in addition to the underlying tables, should be included in the inputs of a command which queries a view. This is useful when we want to know exactly what inputs need to be present in order to run the query run by a user. was:Views, in addition to the underlying tables, should be included in the inputs of a command which queries a view. Views should be added to the inputs of queries. --- Key: HIVE-2756 URL: https://issues.apache.org/jira/browse/HIVE-2756 Project: Hive Issue Type: Improvement Reporter: Kevin Wilfong Assignee: Kevin Wilfong Views, in addition to the underlying tables, should be included in the inputs of a command which queries a view. This is useful when we want to know exactly what inputs need to be present in order to run the query run by a user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2761) Remove lib/javaewah-0.3.jar
[ https://issues.apache.org/jira/browse/HIVE-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13199043#comment-13199043 ] Daniel Lemire commented on HIVE-2761: - That is correct. We upgraded the version of JavaEWAH to 0.3.1 when we posted it to the Maven central repository. Version 0.3.2 is simply a revision of the documentation (I corrected a few typos in the comments). You should be able to call on JavaEWAH as a dependency in the following manner: dependencies dependency groupIdcom.googlecode.javaewah/groupId artifactIdJavaEWAH/artifactId version0.3.2/version /dependency /dependencies The upgrade from 0.3.0 to 0.3.2 should be harmless. Remove lib/javaewah-0.3.jar --- Key: HIVE-2761 URL: https://issues.apache.org/jira/browse/HIVE-2761 Project: Hive Issue Type: Bug Components: Build Infrastructure Affects Versions: 0.8.0, 0.8.1, 0.9.0 Reporter: Ashutosh Chauhan Fix For: 0.9.0 After HIVE-2391 it is retrieved from maven repo via ivy, we can get rid of it from our lib/ -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2756) Views should be added to the inputs of queries.
[ https://issues.apache.org/jira/browse/HIVE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2756: -- Attachment: HIVE-2756.D1575.1.patch kevinwilfong requested code review of HIVE-2756 [jira] Views should be added to the inputs of queries.. Reviewers: JIRA https://issues.apache.org/jira/browse/HIVE-2756 Add the view to the inputs right before it is replaced by its underlying query in the SemanticAnalyzer. Views, in addition to the underlying tables, should be included in the inputs of a command which queries a view. This is useful when we want to know exactly what inputs need to be present in order to run the query run by a user. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D1575 AFFECTED FILES ql/src/test/results/clientnegative/create_or_replace_view7.q.out ql/src/test/results/clientnegative/recursive_view.q.out ql/src/test/results/clientnegative/invalidate_view1.q.out ql/src/test/results/clientpositive/create_or_replace_view.q.out ql/src/test/results/clientpositive/create_view.q.out ql/src/test/results/clientpositive/create_big_view.q.out ql/src/test/results/clientpositive/alter_view_rename.q.out ql/src/test/results/clientpositive/create_view_partitioned.q.out ql/src/test/results/clientpositive/ppd_union_view.q.out ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/3303/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. Views should be added to the inputs of queries. --- Key: HIVE-2756 URL: https://issues.apache.org/jira/browse/HIVE-2756 Project: Hive Issue Type: Improvement Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2756.D1575.1.patch Views, in addition to the underlying tables, should be included in the inputs of a command which queries a view. This is useful when we want to know exactly what inputs need to be present in order to run the query run by a user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2762) Alter Table Partition Concatenate Fails On Certain Characters
[ https://issues.apache.org/jira/browse/HIVE-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2762: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin Alter Table Partition Concatenate Fails On Certain Characters - Key: HIVE-2762 URL: https://issues.apache.org/jira/browse/HIVE-2762 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2762.1.patch.txt, HIVE-2762.2.patch.txt, HIVE-2762.D1533.1.patch, HIVE-2762.D1533.2.patch, HIVE-2762.D1533.3.patch Alter table partition concatenate creates a Java URI object for the location of a partition. If the partition name contains certain characters, such as } or space ' ', the object constructor fails, causing the query to fail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2762) Alter Table Partition Concatenate Fails On Certain Characters
[ https://issues.apache.org/jira/browse/HIVE-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2762: --- Component/s: Metastore Fix Version/s: 0.9.0 Alter Table Partition Concatenate Fails On Certain Characters - Key: HIVE-2762 URL: https://issues.apache.org/jira/browse/HIVE-2762 Project: Hive Issue Type: Bug Components: Metastore Reporter: Kevin Wilfong Assignee: Kevin Wilfong Fix For: 0.9.0 Attachments: HIVE-2762.1.patch.txt, HIVE-2762.2.patch.txt, HIVE-2762.D1533.1.patch, HIVE-2762.D1533.2.patch, HIVE-2762.D1533.3.patch Alter table partition concatenate creates a Java URI object for the location of a partition. If the partition name contains certain characters, such as } or space ' ', the object constructor fails, causing the query to fail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2747) UNION ALL with subquery which selects NULL and performs group by fails
[ https://issues.apache.org/jira/browse/HIVE-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13199099#comment-13199099 ] Namit Jain commented on HIVE-2747: -- create table tmp_tx1 (key string, value string); insert overwrite table tmp_tx1 select * from src where key 10; create table tmp_tx2 (key int, value string); insert overwrite table tmp_tx2 select * from src where key 10; select * from ( select key, count(1) from tmp_tx1 group by key union all select key, count(1) from tmp_tx2 group by key ) u; The above also fails. Basically, if the types of the union dont match, we get a run-time error. The query: select * from ( select key, count(1) from tmp_tx1 group by key union all select cast(key as string) as key, count(1) from tmp_tx2 group by key ) u; works fine UNION ALL with subquery which selects NULL and performs group by fails -- Key: HIVE-2747 URL: https://issues.apache.org/jira/browse/HIVE-2747 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong Queries like the following from (select key, value, count(1) as count from src group by key, value union all select NULL as key, value, count(1) as count from src group by value) a select count(*); fail with the exception java.lang.NullPointerException at org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:60) at java.lang.String.valueOf(String.java:2826) at java.lang.StringBuilder.append(StringBuilder.java:115) at org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:427) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:98) ... 18 more This should at least provide a more informative error message if not work. It works without the group by. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Not able to create table in hive
Hi, I am trying to create a table in Hive using below DDL: CREATE TABLE pokes (foo INT, bar STRING); I am getting below error, I have logged in as admin user : FAILED: Error in metadata: javax.jdo.JDOFatalDataStoreException: Cannot get a connection, pool error Could not create a validated object, cause: A read-only user or a user in a read-only database is not permitted to disable read-only mode on a connection. NestedThrowables: org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error Could not create a validated object, cause: A read-only user or a user in a read-only database is not permitted to disable read-only mode on a connection. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask Any idea? Thank You, Manish
Hive-0.8.1-SNAPSHOT-h0.21 - Build # 183 - Fixed
Changes for Build #181 Changes for Build #182 Changes for Build #183 All tests passed The Apache Jenkins build system has built Hive-0.8.1-SNAPSHOT-h0.21 (build #183) Status: Fixed Check console output at https://builds.apache.org/job/Hive-0.8.1-SNAPSHOT-h0.21/183/ to view the results.
[jira] [Commented] (HIVE-2747) UNION ALL with subquery which selects NULL and performs group by fails
[ https://issues.apache.org/jira/browse/HIVE-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13199153#comment-13199153 ] Kevin Wilfong commented on HIVE-2747: - Namit, that looks like the issue in the JIRA https://issues.apache.org/jira/browse/HIVE-2305 UNION ALL with subquery which selects NULL and performs group by fails -- Key: HIVE-2747 URL: https://issues.apache.org/jira/browse/HIVE-2747 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong Queries like the following from (select key, value, count(1) as count from src group by key, value union all select NULL as key, value, count(1) as count from src group by value) a select count(*); fail with the exception java.lang.NullPointerException at org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:60) at java.lang.String.valueOf(String.java:2826) at java.lang.StringBuilder.append(StringBuilder.java:115) at org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:427) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:98) ... 18 more This should at least provide a more informative error message if not work. It works without the group by. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2747) UNION ALL with subquery which selects NULL and performs group by fails
[ https://issues.apache.org/jira/browse/HIVE-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2747: - Assignee: (was: Kevin Wilfong) UNION ALL with subquery which selects NULL and performs group by fails -- Key: HIVE-2747 URL: https://issues.apache.org/jira/browse/HIVE-2747 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Queries like the following from (select key, value, count(1) as count from src group by key, value union all select NULL as key, value, count(1) as count from src group by value) a select count(*); fail with the exception java.lang.NullPointerException at org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:60) at java.lang.String.valueOf(String.java:2826) at java.lang.StringBuilder.append(StringBuilder.java:115) at org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:427) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:98) ... 18 more This should at least provide a more informative error message if not work. It works without the group by. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2747) UNION ALL with subquery which selects NULL and performs group by fails
[ https://issues.apache.org/jira/browse/HIVE-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13199166#comment-13199166 ] Namit Jain commented on HIVE-2747: -- Even a error message for now is fine. The implicit type conversion can be done later. UNION ALL with subquery which selects NULL and performs group by fails -- Key: HIVE-2747 URL: https://issues.apache.org/jira/browse/HIVE-2747 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Queries like the following from (select key, value, count(1) as count from src group by key, value union all select NULL as key, value, count(1) as count from src group by value) a select count(*); fail with the exception java.lang.NullPointerException at org.apache.hadoop.hive.serde2.objectinspector.StructObjectInspector.toString(StructObjectInspector.java:60) at java.lang.String.valueOf(String.java:2826) at java.lang.StringBuilder.append(StringBuilder.java:115) at org.apache.hadoop.hive.ql.exec.UnionOperator.initializeOp(UnionOperator.java:110) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:427) at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357) at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:98) ... 18 more This should at least provide a more informative error message if not work. It works without the group by. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2776) Setting test.silent=false has not effect
Setting test.silent=false has not effect Key: HIVE-2776 URL: https://issues.apache.org/jira/browse/HIVE-2776 Project: Hive Issue Type: Bug Components: Testing Infrastructure Reporter: Carl Steinbach -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2776) Setting test.silent=false has not effect
[
https://issues.apache.org/jira/browse/HIVE-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13199175#comment-13199175
]
Carl Steinbach commented on HIVE-2776:
--
QTestUtil and the various CliDriver templates all print out the following help
message:
{noformat}
try ant test ... -Dtest.silent=false to get more logs.
{noformat}
However, it turns out that test.silent=false by default, and you change the
behavior of the tests only by setting test.silent=true.
From MapredLocalTask:
{noformat}
String isSilent =
true.equalsIgnoreCase(System.getProperty(test.silent)) ? -nolog : ;
{noformat}
From MapRedTask:
{noformat}
String isSilent = true.equalsIgnoreCase(System
.getProperty(test.silent)) ? -nolog : ;
{noformat}
Setting test.silent=false has not effect
Key: HIVE-2776
URL: https://issues.apache.org/jira/browse/HIVE-2776
Project: Hive
Issue Type: Bug
Components: Testing Infrastructure
Reporter: Carl Steinbach
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2756) Views should be added to the inputs of queries.
[ https://issues.apache.org/jira/browse/HIVE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2756: - Status: Patch Available (was: Open) Views should be added to the inputs of queries. --- Key: HIVE-2756 URL: https://issues.apache.org/jira/browse/HIVE-2756 Project: Hive Issue Type: Improvement Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2756.D1575.1.patch Views, in addition to the underlying tables, should be included in the inputs of a command which queries a view. This is useful when we want to know exactly what inputs need to be present in order to run the query run by a user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2756) Views should be added to the inputs of queries.
[ https://issues.apache.org/jira/browse/HIVE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13199251#comment-13199251 ] Phabricator commented on HIVE-2756: --- njain has accepted the revision HIVE-2756 [jira] Views should be added to the inputs of queries.. REVISION DETAIL https://reviews.facebook.net/D1575 Views should be added to the inputs of queries. --- Key: HIVE-2756 URL: https://issues.apache.org/jira/browse/HIVE-2756 Project: Hive Issue Type: Improvement Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2756.D1575.1.patch Views, in addition to the underlying tables, should be included in the inputs of a command which queries a view. This is useful when we want to know exactly what inputs need to be present in order to run the query run by a user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1634) Allow access to Primitive types stored in binary format in HBase
[ https://issues.apache.org/jira/browse/HIVE-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-1634: -- Attachment: HIVE-1634.D1581.1.patch ashutoshc requested code review of HIVE-1634 [jira] Allow access to Primitive types stored in binary format in HBase. Reviewers: JIRA https://issues.apache.org/jira/browse/HIVE-1634 Rebased the patch to the trunk. This patch adds support binary storage support for HBase tables. What that means is if you have existing hbase tables (that is those not written through hive) you can use query them now using hbase-handler. Without this patch, you can only read hbase tables which were stored through hive. Test Plan: 3 new .q files hbase_binary_external_table_queries.q hbase_binary_map_queries.q hbase_binary_storage_queries.q which has new tests. This addresses HIVE-1245 in part, for atomic or primitive types. The serde property hbase.columns.storage.types = ,b,b,b,b,b,b,b,b is a specification of the storage option for the corresponding column in the serde property hbase.columns.mapping. Allowed values are '' for table default, 's' for standard string storage, and 'b' for binary storage as would be obtained from o.a.h.hbase.utils.Bytes. Map types for HBase column families use a colon separated pair such as 's:b' for the key and value part specifiers respectively. See the test cases and queries for HBase handler for additional examples. There is also a table property hbase.table.default.storage.type = string to specify a table level default storage type. The other valid specification is binary. The table level default is overridden by a column level specification. This control is available for the boolean, tinyint, smallint, int, bigint, float, and double primitive types. The attached patch also relaxes the mapping of map types to HBase column families to allow any primitive type to be the map key. Attached is a program for creating a table and populating it in HBase. The external table in Hive can access the data as shown in the example below. hive create external table TestHiveHBaseExternalTable (key string, c_bool boolean, c_byte tinyint, c_short smallint, c_int int, c_long bigint, c_string string, c_float float, c_double double) stored by 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' with serdeproperties (hbase.columns.mapping = :key,cf:boolean,cf:byte,cf:short,cf:int,cf:long,cf:string,cf:float,cf:double) tblproperties (hbase.table.name = TestHiveHBaseExternalTable); OK Time taken: 0.691 seconds hive select * from TestHiveHBaseExternalTable; OK key-1 NULLNULLNULLNULLNULLTest-String NULLNULL Time taken: 0.346 seconds hive drop table TestHiveHBaseExternalTable; OK Time taken: 0.139 seconds hive create external table TestHiveHBaseExternalTable (key string, c_bool boolean, c_byte tinyint, c_short smallint, c_int int, c_long bigint, c_string string, c_float float, c_double double) stored by 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' with serdeproperties ( hbase.columns.mapping = :key,cf:boolean,cf:byte,cf:short,cf:int,cf:long,cf:string,cf:float,cf:double, hbase.columns.storage.types = -,b,b,b,b,b,b,b,b ) tblproperties ( hbase.table.name = TestHiveHBaseExternalTable, hbase.table.default.storage.type = string); OK Time taken: 0.139 seconds hive select * from TestHiveHBaseExternalTable; OK key-1 true-128-32768 -2147483648 -9223372036854775808 Test-String -2.1793132E-11 2.01345E291 Time taken: 0.151 seconds hive drop table TestHiveHBaseExternalTable; OK Time taken: 0.154 seconds hive create external table TestHiveHBaseExternalTable (key string, c_bool boolean, c_byte tinyint, c_short smallint, c_int int, c_long bigint, c_string string, c_float float, c_double double) stored by 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' with serdeproperties ( hbase.columns.mapping = :key,cf:boolean,cf:byte,cf:short,cf:int,cf:long,cf:string,cf:float,cf:double, hbase.columns.storage.types = ,b,b,b,b,b,,b,b ) tblproperties (hbase.table.name = TestHiveHBaseExternalTable); OK Time taken: 0.347 seconds hive select * from TestHiveHBaseExternalTable; OK key-1 true-128-32768 -2147483648 -9223372036854775808 Test-String -2.1793132E-11 2.01345E291 Time taken: 0.245 seconds hive TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D1581 AFFECTED FILES hbase-handler/src/test/results/hbase_binary_external_table_queries.q.out hbase-handler/src/test/results/hbase_binary_map_queries.q.out hbase-handler/src/test/results/hbase_binary_storage_queries.q.out hbase-handler/src/test/org/apache/hadoop/hive/hbase/HBaseTestSetup.java
[jira] [Updated] (HIVE-1938) Cost Based Query optimization for Joins in Hive
[ https://issues.apache.org/jira/browse/HIVE-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1938: - Component/s: Statistics Cost Based Query optimization for Joins in Hive --- Key: HIVE-1938 URL: https://issues.apache.org/jira/browse/HIVE-1938 Project: Hive Issue Type: Improvement Components: Query Processor, Statistics Environment: *nix,java Reporter: bharath v Assignee: bharath v Current optimization in Hive is just rule-based and involves applying a set of rules on the Plan tree. This depends on hints given by the user (which may or may-not be correct) and might result in execution of costlier plans.So this jira aims at building a cost-model which can give a good estimate various plans before hand (using some meta-data already collected) and we can choose the best plan which incurs the least cost. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2472) Metastore statistics are not being updated for CTAS queries.
[ https://issues.apache.org/jira/browse/HIVE-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2472: - Component/s: Statistics Metastore statistics are not being updated for CTAS queries. Key: HIVE-2472 URL: https://issues.apache.org/jira/browse/HIVE-2472 Project: Hive Issue Type: Bug Components: Statistics Reporter: Kevin Wilfong Assignee: Robert Surówka Fix For: 0.8.0 Attachments: HIVE-2472.1.patch.txt, HIVE-2472.2.patch, HIVE-2472.3.patch, HIVE-2472.4.patch, HIVE-2472.5.patch We need to add a Statistics task at the end of a CTAS query in order to update the metastore statistics for the table being created. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-33) [Hive]: Add ability to compute statistics on hive tables
[ https://issues.apache.org/jira/browse/HIVE-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-33: --- Component/s: Statistics [Hive]: Add ability to compute statistics on hive tables Key: HIVE-33 URL: https://issues.apache.org/jira/browse/HIVE-33 Project: Hive Issue Type: New Feature Components: Query Processor, Statistics Reporter: Ashish Thusoo Labels: statistics Add commands to collect partition and column level statistics in hive. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2554) Hive authorization with remote metastore does not work
[
https://issues.apache.org/jira/browse/HIVE-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach updated HIVE-2554:
-
Component/s: Authorization
Hive authorization with remote metastore does not work
--
Key: HIVE-2554
URL: https://issues.apache.org/jira/browse/HIVE-2554
Project: Hive
Issue Type: Bug
Components: Authorization, Security
Affects Versions: 0.7.1
Environment: CentOS release 5.7
Hadoop 0.20.2 (pseudo-distributed mode)
Reporter: Alex Holmes
*Install Hadoop 0.20.2*
# Explode Hadoop 0.20.2 tarball
# Configure for pseudo-distributed mode from [Hadoop
site|http://hadoop.apache.org/common/docs/r0.20.2/quickstart.html#PseudoDistributed]
# Create user hadoop
# Start all Hadoop daemons as user hadoop
*Install Hive 0.7.1*
# Explode Hive 0.7.1 tarball
# Create user hive
# Configure Hive to run with remote metastore, and with authentication.
Contents of hive-site.xml are:
{code}
configuration
property
namehive.metastore.local/name
valuefalse/value
/property
property
namehive.metastore.uris/name
valuethrift://localhost:9083/value
/property
property
namehive.security.authorization.enabled/name
valuetrue/value
/property
/configuration
{code}
# Create and open-up the Hive-related directories in HDFS
hadoop fs -mkdir /user/hive/warehouse
hadoop fs -chmod -R 777 /user/hive/warehouse
hadoop fs -mkdir /tmp
hadoop fs -chmod -R 777 /tmp
*Run the metastore*
./hive --service metastore
*Run the hive client*
The exception below is thrown regardless of which user is running the
metastore and client (tried as both the hive and hadoop users, and
combinations thereof).
{code}
./hive
hive set hive.security.authorization.enabled=false;
hive CREATE TABLE pokes (foo INT, bar STRING) ROW FORMAT DELIMITED FIELDS
TERMINATED BY '-' STORED AS TEXTFILE;
OK
hive LOAD DATA LOCAL INPATH '/tmp/foobar.txt' OVERWRITE INTO TABLE pokes;
Copying data from file:/tmp/foobar.txt
Copying file: file:/tmp/foobar.txt
Loading data to table default.pokes
Deleted hdfs://localhost:9000/user/hive/warehouse/pokes
OK
Time taken: 0.443 seconds
hive grant select on table pokes to user hive;
OK
Time taken: 0.191 seconds
hive set hive.security.authorization.enabled=true;
hive show grant user hive on table pokes;
OK
database default
table pokes
principalName hive
principalType USER
privilege Select
grantTime 1320642081
grantor hadoop
Time taken: 0.084 seconds
hive select * from pokes;
FAILED: Hive Internal Error:
org.apache.hadoop.hive.ql.metadata.HiveException(org.apache.thrift.TApplicationException:
get_privilege_set failed: unknown result)
org.apache.hadoop.hive.ql.metadata.HiveException:
org.apache.thrift.TApplicationException: get_privilege_set failed: unknown
result
at
org.apache.hadoop.hive.ql.metadata.Hive.get_privilege_set(Hive.java:1617)
at
org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.authorizeUserPriv(DefaultHiveAuthorizationProvider.java:201)
at
org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.authorizeUserAndDBPriv(DefaultHiveAuthorizationProvider.java:226)
at
org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.authorizeUserDBAndTable(DefaultHiveAuthorizationProvider.java:259)
at
org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.authorize(DefaultHiveAuthorizationProvider.java:159)
at org.apache.hadoop.hive.ql.Driver.doAuthorization(Driver.java:531)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:393)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:736)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: org.apache.thrift.TApplicationException: get_privilege_set failed:
unknown result
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_privilege_set(ThriftHiveMetastore.java:2414)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_privilege_set(ThriftHiveMetastore.java:2379)
at
[jira] [Updated] (HIVE-2241) Thrift MetaStore interface bypasses authorization checks
[ https://issues.apache.org/jira/browse/HIVE-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2241: - Component/s: Authorization Thrift MetaStore interface bypasses authorization checks Key: HIVE-2241 URL: https://issues.apache.org/jira/browse/HIVE-2241 Project: Hive Issue Type: Bug Components: Authorization, JDBC, Metastore, ODBC, Security Reporter: Carl Steinbach Assignee: Enis Soztutar Hive's authorization mechanism works with DML and DDL statements only. Authorization checks are not applied when a Thrift client directly accesses the Metastore's Thrift interface, e.g. create_table(), drop_table(), alter_table(), get_databases(), get_tables(), etc. Catalog functions such as get_databases() and get_tables() are directly accessed by JDBC and ODBC drivers. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-78) Authorization infrastructure for Hive
[ https://issues.apache.org/jira/browse/HIVE-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-78: --- Component/s: Authorization Authorization infrastructure for Hive - Key: HIVE-78 URL: https://issues.apache.org/jira/browse/HIVE-78 Project: Hive Issue Type: New Feature Components: Authorization, Metastore, Query Processor, Security, Server Infrastructure Reporter: Ashish Thusoo Assignee: He Yongqiang Labels: authorization Fix For: 0.7.0 Attachments: HIVE-78.1.nothrift.patch, HIVE-78.1.thrift.patch, HIVE-78.10.no_thrift.patch, HIVE-78.11.patch, HIVE-78.12.2.patch, HIVE-78.12.3.patch, HIVE-78.12.4.patch, HIVE-78.12.5.patch, HIVE-78.12.patch, HIVE-78.2.nothrift.patch, HIVE-78.2.thrift.patch, HIVE-78.4.complete.patch, HIVE-78.4.no_thrift.patch, HIVE-78.5.complete.patch, HIVE-78.5.no_thrift.patch, HIVE-78.6.complete.patch, HIVE-78.6.no_thrift.patch, HIVE-78.7.no_thrift.patch, HIVE-78.7.patch, HIVE-78.9.no_thrift.patch, HIVE-78.9.patch, createuser-v1.patch, hive-78-metadata-v1.patch, hive-78-syntax-v1.patch, hive-78.diff Allow hive to integrate with existing user repositories for authentication and authorization infromation. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1930) new configuration to disable all authorization related metadata changes
[ https://issues.apache.org/jira/browse/HIVE-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1930: - Component/s: Authorization new configuration to disable all authorization related metadata changes --- Key: HIVE-1930 URL: https://issues.apache.org/jira/browse/HIVE-1930 Project: Hive Issue Type: Improvement Components: Authorization Reporter: Namit Jain Assignee: He Yongqiang Even if authorization is disabled, some entries are inserted in the metastore related to privileges. There should be a easy way to disable all authorization changes completely. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1935) set hive.security.authorization.createtable.owner.grants to null by default
[ https://issues.apache.org/jira/browse/HIVE-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1935: - Component/s: Authorization set hive.security.authorization.createtable.owner.grants to null by default --- Key: HIVE-1935 URL: https://issues.apache.org/jira/browse/HIVE-1935 Project: Hive Issue Type: Bug Components: Authorization, Security Reporter: He Yongqiang Assignee: He Yongqiang Fix For: 0.7.0 Attachments: HIVE-1935.1.patch It seems an empty setting in hive-size.xml does not overwrite hive-default.xml -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1696) Add delegation token support to metastore
[ https://issues.apache.org/jira/browse/HIVE-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1696: - Component/s: Authentication Add delegation token support to metastore - Key: HIVE-1696 URL: https://issues.apache.org/jira/browse/HIVE-1696 Project: Hive Issue Type: Sub-task Components: Authentication, Metastore, Security, Server Infrastructure Reporter: Todd Lipcon Assignee: Devaraj Das Fix For: 0.7.0 Attachments: hive-1696-1-with-gen-code.patch, hive-1696-1.patch, hive-1696-3-with-gen-code.patch, hive-1696-3.patch, hive-1696-4-with-gen-code.1.patch, hive-1696-4-with-gen-code.patch, hive-1696-4.patch, hive-1696-4.patch, hive_1696.patch, hive_1696.patch, hive_1696_no-thrift.patch As discussed in HIVE-842, kerberos authentication is only sufficient for authentication of a hive user client to the metastore. There are other cases where thrift calls need to be authenticated when the caller is running in an environment without kerberos credentials. For example, an MR task running as part of a hive job may want to report statistics to the metastore, or a job may be running within the context of Oozie or Hive Server. This JIRA is to implement support of delegation tokens for the metastore. The concept of a delegation token is borrowed from the Hadoop security design - the quick summary is that a kerberos-authenticated client may retrieve a binary token from the server. This token can then be passed to other clients which can use it to achieve authentication as the original user in lieu of a kerberos ticket. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-842) Authentication Infrastructure for Hive
[ https://issues.apache.org/jira/browse/HIVE-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-842: Component/s: Authentication Authentication Infrastructure for Hive -- Key: HIVE-842 URL: https://issues.apache.org/jira/browse/HIVE-842 Project: Hive Issue Type: New Feature Components: Authentication, Security, Server Infrastructure Reporter: Edward Capriolo Assignee: Todd Lipcon Fix For: 0.7.0 Attachments: HiveSecurityThoughts.pdf, hive-842.txt, hive-842_2.patch This issue deals with the authentication (user name,password) infrastructure. Not the authorization components that specify what a user should be able to do. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2743) Enable SASL mode for HiveServer
[ https://issues.apache.org/jira/browse/HIVE-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2743: - Component/s: Authentication Enable SASL mode for HiveServer --- Key: HIVE-2743 URL: https://issues.apache.org/jira/browse/HIVE-2743 Project: Hive Issue Type: New Feature Components: Authentication, Security, Server Infrastructure Reporter: Carl Steinbach Assignee: Carl Steinbach -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2093) create/drop database should populate inputs/outputs and check concurrency and user permission
[ https://issues.apache.org/jira/browse/HIVE-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2093: - Component/s: Locking Authorization create/drop database should populate inputs/outputs and check concurrency and user permission - Key: HIVE-2093 URL: https://issues.apache.org/jira/browse/HIVE-2093 Project: Hive Issue Type: Bug Components: Authorization, Locking, Metastore, Security Reporter: Namit Jain Assignee: Siying Dong Attachments: HIVE-2093.6.patch, HIVE.2093.1.patch, HIVE.2093.2.patch, HIVE.2093.3.patch, HIVE.2093.4.patch, HIVE.2093.5.patch concurrency and authorization are needed for create/drop table. Also to make concurrency work, it's better to have LOCK/UNLOCK DATABASE and SHOW LOCKS DATABASE -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1648) Automatically gathering statistics when reading a table/partition
[ https://issues.apache.org/jira/browse/HIVE-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1648: - Component/s: Statistics Summary: Automatically gathering statistics when reading a table/partition (was: Automatically gathering stats when reading a table/partition) Automatically gathering statistics when reading a table/partition - Key: HIVE-1648 URL: https://issues.apache.org/jira/browse/HIVE-1648 Project: Hive Issue Type: Sub-task Components: Statistics Reporter: Ning Zhang Assignee: Paul Butler Attachments: HIVE-1648.2.patch, HIVE-1648.3.patch, HIVE-1648.4.patch, HIVE-1648.5.patch, HIVE-1648.patch, hive-1648.svn.patch HIVE-1361 introduces a new command 'ANALYZE TABLE T COMPUTE STATISTICS' to gathering stats. This requires additional scan of the data. Stats gathering can be piggy-backed on TableScanOperator whenever a table/partition is scanned (given not LIMIT operator). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1240 - Still Failing
Changes for Build #1198 [namit] HIVE-2504 Warehouse table subdirectories should inherit the group permissions of the warehouse parent directory (Chinna Rao Lalam via namit) [namit] HIVE-2695 Add PRINTF() Udf (Zhenxiao Luo via namit) Changes for Build #1199 Changes for Build #1200 Changes for Build #1201 Changes for Build #1202 Changes for Build #1203 Changes for Build #1204 [cws] HIVE-2719. Revert HIVE-2589 (He Yongqiang via cws) Changes for Build #1205 Changes for Build #1207 [namit] HIVE-2718 NPE in union followed by join (He Yongqiang via namit) Changes for Build #1208 Changes for Build #1209 Changes for Build #1210 [namit] HIVE-2674 get_partitions_ps throws TApplicationException if table doesn't exist (Kevin Wilfong via namit) Changes for Build #1211 [cws] HIVE-2203. Extend concat_ws() UDF to support arrays of strings (Zhenxiao Luo via cws) [cws] HIVE-2279. Implement sort(array) UDF (Zhenxiao Luo via cws) Changes for Build #1212 [hashutosh] HIVE-2589 : Newly created partition should inherit properties from table (Ashutosh Chauhan) Changes for Build #1213 Changes for Build #1214 Changes for Build #1215 Changes for Build #1216 [cws] HIVE-2724. Remove unused lib/log4j-1.2.15.jar (Andrew Bayer via cws) Changes for Build #1217 Changes for Build #1218 Changes for Build #1219 [hashutosh] HIVE-2665 : Support for metastore service specific HADOOP_OPTS environment setting (thw via hashutosh) Changes for Build #1220 [namit] HIVE-2727 add a testcase for partitioned view on union and base tables have index (He Yongqiang via namit) Changes for Build #1221 [hashutosh] HIVE-2746 : Metastore client doesn't log properly in case of connection failure to server (hashutosh) [cws] HIVE-2698 [jira] Enable Hadoop-1.0.0 in Hive (Enis Söztutar via Carl Steinbach) Summary: third version of the patch Hadoop-1.0.0 is recently released, which is AFAIK, API compatible to the 0.20S release. Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach CC: cwsteinbach, enis Differential Revision: https://reviews.facebook.net/D1389 Changes for Build #1222 [namit] HIVE-2750 Hive multi group by single reducer optimization causes invalid column reference error (Kevin Wilfong via namit) Changes for Build #1223 Changes for Build #1224 [cws] HIVE-2734 [jira] Fix some nondeterministic test output (Zhenxiao Luo via Carl Steinbach) Summary: HIVE-2734: Fix some nondeterministic test output Many Hive query tests lack an ORDER BY clause, and consequently the ordering of the rows in the result set is nondeterministic: groupby1_limit input11_limit input1_limit input_lazyserde join18_multi_distinct join_1to1 join_casesensitive join_filters join_nulls merge3 rcfile_columnar rcfile_lazydecompress rcfile_union sample10 udf_sentences union24 columnarserde_create_shortcut combine1 global_limit Test Plan: EMPTY Reviewers: JIRA, cwsteinbach Reviewed By: cwsteinbach CC: zhenxiao, cwsteinbach Differential Revision: https://reviews.facebook.net/D1449 [namit] HIVE-2754 NPE in union with lateral view (Yongqiang He via namit) Changes for Build #1225 Changes for Build #1226 Changes for Build #1227 [namit] HIVE-2755 union follwowed by union_subq does not work if the subquery union has reducers (He Yongqiang via namit) Changes for Build #1228 Changes for Build #1229 [hashutosh] HIVE-2735: PlanUtils.configureTableJobPropertiesForStorageHandler() is not called for partitioned table (sushanth via ashutosh) Changes for Build #1230 [cws] HIVE-2760 [jira] TestCliDriver should log elapsed time Summary: HIVE-2760. TestCliDriver should log elapsed time Test Plan: EMPTY Reviewers: JIRA, ashutoshc Reviewed By: ashutoshc CC: ashutoshc, cwsteinbach Differential Revision: https://reviews.facebook.net/D1503 [cws] HIVE-2662 [jira] Add Ant configuration property for dumping classpath of tests Summary: HIVE-2662. Add Ant configuration property for dumping classpath of tests Test Plan: EMPTY Reviewers: JIRA, jsichi, ashutoshc Reviewed By: ashutoshc CC: ashutoshc Differential Revision: https://reviews.facebook.net/D903 Changes for Build #1231 [hashutosh] HIVE_2645: Hive Web Server startup messages logs incorrect path it is searching for WAR (Edward Capriolo via Ashutosh Chauhan) Changes for Build #1232 Changes for Build #1233 [sdong] HIVE-2249 When creating constant expression for numbers, try to infer type from another comparison operand, instead of trying to use integer first, and then long and double (Zhiqiu Kong via Siying Dong) Changes for Build #1234 Changes for Build #1235 [heyongqiang] HIVE-2765 hbase handler uses ZooKeeperConnectionException which is not compatible with HBase versions other than 0.89 (Pei Yue via He Yongqiang) Changes for Build #1236 Changes for Build #1237 Changes for Build #1238 [heyongqiang] HIVE-2772 [jira] make union31.q deterministic (Namit Jain via Yongqiang He) Summary: https://issues.apache.org/jira/browse/HIVE-2772 HIVE-2772 Test
[jira] [Commented] (HIVE-2762) Alter Table Partition Concatenate Fails On Certain Characters
[ https://issues.apache.org/jira/browse/HIVE-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13199375#comment-13199375 ] Hudson commented on HIVE-2762: -- Integrated in Hive-trunk-h0.21 #1240 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1240/]) HIVE-2762 Alter Table Partition Concatenate Fails On Certain Characters (Kevin Wilfong via namit) namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1239754 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java * /hive/trunk/ql/src/test/queries/clientpositive/escape2.q * /hive/trunk/ql/src/test/results/clientpositive/escape2.q.out Alter Table Partition Concatenate Fails On Certain Characters - Key: HIVE-2762 URL: https://issues.apache.org/jira/browse/HIVE-2762 Project: Hive Issue Type: Bug Components: Metastore Reporter: Kevin Wilfong Assignee: Kevin Wilfong Fix For: 0.9.0 Attachments: HIVE-2762.1.patch.txt, HIVE-2762.2.patch.txt, HIVE-2762.D1533.1.patch, HIVE-2762.D1533.2.patch, HIVE-2762.D1533.3.patch Alter table partition concatenate creates a Java URI object for the location of a partition. If the partition name contains certain characters, such as } or space ' ', the object constructor fails, causing the query to fail. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2372) java.io.IOException: error=7, Argument list too long
[
https://issues.apache.org/jira/browse/HIVE-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13199411#comment-13199411
]
Siying Dong commented on HIVE-2372:
---
Is 2048 per value too long?
java.io.IOException: error=7, Argument list too long
Key: HIVE-2372
URL: https://issues.apache.org/jira/browse/HIVE-2372
Project: Hive
Issue Type: Bug
Components: Query Processor
Reporter: Sergey Tryuber
Priority: Critical
Attachments: HIVE-2372.1.patch.txt
I execute a huge query on a table with a lot of 2-level partitions. There is
a perl reducer in my query. Maps worked ok, but every reducer fails with the
following exception:
2011-08-11 04:58:29,865 INFO org.apache.hadoop.hive.ql.exec.ScriptOperator:
Executing [/usr/bin/perl, reducer.pl, my_argument]
2011-08-11 04:58:29,866 INFO org.apache.hadoop.hive.ql.exec.ScriptOperator:
tablename=null
2011-08-11 04:58:29,866 INFO org.apache.hadoop.hive.ql.exec.ScriptOperator:
partname=null
2011-08-11 04:58:29,866 INFO org.apache.hadoop.hive.ql.exec.ScriptOperator:
alias=null
2011-08-11 04:58:29,935 FATAL ExecReducer:
org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
processing row (tag=0)
{key:{reducesinkkey0:129390185139228,reducesinkkey1:8AF163CA6F},value:{_col0:8AF163CA6F,_col1:2011-07-27
22:48:52,_col2:129390185139228,_col3:2006,_col4:4100,_col5:10017388=6,_col6:1063,_col7:NULL,_col8:address.com,_col9:NULL,_col10:NULL},alias:0}
at
org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:256)
at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:468)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:416)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1115)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Cannot
initialize ScriptOperator
at
org.apache.hadoop.hive.ql.exec.ScriptOperator.processOp(ScriptOperator.java:320)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:744)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:744)
at
org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(ExtractOperator.java:45)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at
org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:247)
... 7 more
Caused by: java.io.IOException: Cannot run program /usr/bin/perl:
java.io.IOException: error=7, Argument list too long
at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)
at
org.apache.hadoop.hive.ql.exec.ScriptOperator.processOp(ScriptOperator.java:279)
... 15 more
Caused by: java.io.IOException: java.io.IOException: error=7, Argument list
too long
at java.lang.UNIXProcess.init(UNIXProcess.java:148)
at java.lang.ProcessImpl.start(ProcessImpl.java:65)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
... 16 more
It seems to me, I found the cause. ScriptOperator.java puts a lot of configs
as environment variables to the child reduce process. One of variables is
mapred.input.dir, which in my case more than 150KB. There are a huge amount
of input directories in this variable. In short, the problem is that Linux
(up to 2.6.23 kernel version) limits summary size of environment variables
for child processes to 132KB. This problem could be solved by upgrading the
kernel. But strings limitations still be 132KB per string in environment
variable. So such huge variable doesn't work even on my home computer
(2.6.32). You can read more information on
(http://www.kernel.org/doc/man-pages/online/pages/man2/execve.2.html).
For now all our work has been stopped because of this problem and I can't
find the solution. The only solution, which seems to me more reasonable is to
get rid of this variable in reducers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2542) DROP DATABASE CASCADE does not drop non-native tables.
[ https://issues.apache.org/jira/browse/HIVE-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vandana Ayyalasomayajula updated HIVE-2542: --- Attachment: Hive-2542.03.patch DROP DATABASE CASCADE does not drop non-native tables. --- Key: HIVE-2542 URL: https://issues.apache.org/jira/browse/HIVE-2542 Project: Hive Issue Type: Bug Components: Metastore Reporter: Vandana Ayyalasomayajula Assignee: Vandana Ayyalasomayajula Labels: handler, hive, metastore, storage Attachments: Hive-2542.03.patch, Hive-2542.patch The hive meta store client does not delete the non-native tables during the drop database dbname cascade operation. As a result even though the database is deleted the tables still exist. This is related to HCATALOG-144. A deeper look at the HiveMetaStoreClient's dropDatabase function, tells us that the function does not utilize the hive meta hooks of the tables in the database for dropping the non-native tables. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Table not creating in hive
Hello Bejoy Alexis, Thanks for your reply. I am using mysql as a database (and not derby) Previuosly I am using --split by 1 and is working fine, but when I installed MySQL and change the database then I got the error for --split-by option and thats why I use -m 1. But again due to that it is showing that data retrieve is 0. Here are the logs. hadoop@ubuntu:~/sqoop-1.3.0-cdh3u1/bin$ ./sqoop-import --connect 'jdbc:sqlserver://192.168.1.1;username=abcd;password=12345;database=FIGMDHadoopTest' --table Appointment --hive-table appointment -m 1 --hive-import --verbose 12/01/31 22:33:40 DEBUG tool.BaseSqoopTool: Enabled debug logging. 12/01/31 22:33:40 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override 12/01/31 22:33:40 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc. 12/01/31 22:33:40 DEBUG sqoop.ConnFactory: Added factory com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory specified by /home/hadoop/sqoop-1.3.0-cdh3u1/conf/managers.d/mssqoop-sqlserver 12/01/31 22:33:40 DEBUG sqoop.ConnFactory: Loaded manager factory: com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory 12/01/31 22:33:40 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory 12/01/31 22:33:40 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory 12/01/31 22:33:40 INFO SqlServer.MSSQLServerManagerFactory: Using Microsoft's SQL Server - Hadoop Connector 12/01/31 22:33:40 INFO manager.SqlManager: Using default fetchSize of 1000 12/01/31 22:33:40 DEBUG sqoop.ConnFactory: Instantiated ConnManager com.microsoft.sqoop.SqlServer.MSSQLServerManager@116471f 12/01/31 22:33:40 INFO tool.CodeGenTool: Beginning code generation 12/01/31 22:33:40 DEBUG manager.SqlManager: No connection paramenters specified. Using regular API for making connection. 12/01/31 22:33:41 DEBUG manager.SqlManager: Using fetchSize for next query: 1000 12/01/31 22:33:41 INFO manager.SqlManager: Executing SQL statement: SELECT TOP 1 * FROM [Appointment] 12/01/31 22:33:41 DEBUG manager.SqlManager: Using fetchSize for next query: 1000 12/01/31 22:33:41 INFO manager.SqlManager: Executing SQL statement: SELECT TOP 1 * FROM [Appointment] 12/01/31 22:33:41 DEBUG orm.ClassWriter: selected columns: 12/01/31 22:33:41 DEBUG orm.ClassWriter: AppointmentUid 12/01/31 22:33:41 DEBUG orm.ClassWriter: ExternalID 12/01/31 22:33:41 DEBUG orm.ClassWriter: PatientUid 12/01/31 22:33:41 DEBUG orm.ClassWriter: StartTime 12/01/31 22:33:41 DEBUG orm.ClassWriter: EndTime 12/01/31 22:33:41 DEBUG orm.ClassWriter: ResourceUid 12/01/31 22:33:41 DEBUG orm.ClassWriter: Note 12/01/31 22:33:41 DEBUG orm.ClassWriter: AppointmentTypeUid 12/01/31 22:33:41 DEBUG orm.ClassWriter: AppointmentStatusUid 12/01/31 22:33:41 DEBUG orm.ClassWriter: CheckOutNote 12/01/31 22:33:41 DEBUG orm.ClassWriter: CreatedDate 12/01/31 22:33:41 DEBUG orm.ClassWriter: CreatedByUid 12/01/31 22:33:41 DEBUG orm.ClassWriter: Writing source file: /tmp/sqoop-hadoop/compile/a7d94d7420001a743a4746242116beff/Appointment.java 12/01/31 22:33:41 DEBUG orm.ClassWriter: Table name: Appointment 12/01/31 22:33:41 DEBUG orm.ClassWriter: Columns: AppointmentUid:1, ExternalID:12, PatientUid:1, StartTime:93, EndTime:93, ResourceUid:1, RenderringProviderUid:1, ReferringProviderUid:1, ServiceLocationUid:1, Note:-1, AppointmentTypeUid:1, AppointmentStatusUid:1, CheckOutNote:12, ROSxml:-1, CreatedDate:93, CreatedByUid:1, ModifiedDate:93, ModifiedByUid:1, SingleDayAppointmentGroupUid:1, MultiDayAppointmentGroupUid:1, 12/01/31 22:33:41 DEBUG orm.ClassWriter: sourceFilename is Appointment.java 12/01/31 22:33:41 DEBUG orm.CompilationManager: Found existing /tmp/sqoop-hadoop/compile/a7d94d7420001a743a4746242116beff/ 12/01/31 22:33:41 INFO orm.CompilationManager: HADOOP_HOME is /home/hadoop/hadoop-0.20.2-cdh3u2 12/01/31 22:33:41 DEBUG orm.CompilationManager: Adding source file: /tmp/sqoop-hadoop/compile/a7d94d7420001a743a4746242116beff/Appointment.java 12/01/31 22:33:41 DEBUG orm.CompilationManager: Invoking javac with args: 12/01/31 22:33:41 DEBUG orm.CompilationManager: -sourcepath 12/01/31 22:33:41 DEBUG orm.CompilationManager: /tmp/sqoop-hadoop/compile/a7d94d7420001a743a4746242116beff/ 12/01/31 22:33:41 DEBUG orm.CompilationManager: -d 12/01/31 22:33:41 DEBUG orm.CompilationManager: /tmp/sqoop-hadoop/compile/a7d94d7420001a743a4746242116beff/ 12/01/31 22:33:41 DEBUG orm.CompilationManager: -classpath 12/01/31 22:33:41 DEBUG orm.CompilationManager:
[jira] [Updated] (HIVE-2756) Views should be added to the inputs of queries.
[ https://issues.apache.org/jira/browse/HIVE-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2756: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed. Thanks Kevin Views should be added to the inputs of queries. --- Key: HIVE-2756 URL: https://issues.apache.org/jira/browse/HIVE-2756 Project: Hive Issue Type: Improvement Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2756.D1575.1.patch Views, in addition to the underlying tables, should be included in the inputs of a command which queries a view. This is useful when we want to know exactly what inputs need to be present in order to run the query run by a user. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2686) Test ppr_pushdown.q is failing on trunk
[
https://issues.apache.org/jira/browse/HIVE-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-2686:
--
Attachment: HIVE-2686.D1215.3.patch
navis updated the revision HIVE-2686 [jira] Test ppr_pushdown.q is failing on
trunk.
Reviewers: JIRA
Changing topOps to LinkedHashMap made predictable execution plans, but MapRed
task executed with multiple map still induces non-predictable result, which
cannot be corrected. I think I'm done.
For ppr_pushdown, I prefer using explode instead of union, which is more
faster. But it's not an important issue.
Included a fix for trivial-but-critical bug, which registers task with parent
to root task.
Also made best effort to find common union operator which could reduce map
task in CombinHiveInputFormat.
REVISION DETAIL
https://reviews.facebook.net/D1215
AFFECTED FILES
hbase-handler/src/test/results/hbase_queries.q.out
ql/src/java/org/apache/hadoop/hive/ql/io/HiveFileFormatUtils.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRTableScan1.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java
ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java
ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
ql/src/test/queries/clientpositive/ppr_pushdown.q
ql/src/test/queries/clientpositive/union_order.q
ql/src/test/results/clientpositive/auto_join27.q.out
ql/src/test/results/clientpositive/auto_join30.q.out
ql/src/test/results/clientpositive/auto_join31.q.out
ql/src/test/results/clientpositive/join19.q.out
ql/src/test/results/clientpositive/join28.q.out
ql/src/test/results/clientpositive/lineage1.q.out
ql/src/test/results/clientpositive/load_dyn_part14.q.out
ql/src/test/results/clientpositive/ppd_repeated_alias.q.out
ql/src/test/results/clientpositive/ppd_union_view.q.out
ql/src/test/results/clientpositive/ppr_pushdown.q.out
ql/src/test/results/clientpositive/ql_rewrite_gbtoidx.q.out
ql/src/test/results/clientpositive/union20.q.out
ql/src/test/results/clientpositive/union22.q.out
ql/src/test/results/clientpositive/union24.q.out
ql/src/test/results/clientpositive/union25.q.out
ql/src/test/results/clientpositive/union26.q.out
ql/src/test/results/clientpositive/union3.q.out
ql/src/test/results/clientpositive/union_order.q.out
ql/src/test/results/compiler/plan/join4.q.xml
ql/src/test/results/compiler/plan/join5.q.xml
ql/src/test/results/compiler/plan/join6.q.xml
ql/src/test/results/compiler/plan/join7.q.xml
ql/src/test/results/compiler/plan/join8.q.xml
Test ppr_pushdown.q is failing on trunk
---
Key: HIVE-2686
URL: https://issues.apache.org/jira/browse/HIVE-2686
Project: Hive
Issue Type: Test
Components: Testing Infrastructure
Affects Versions: 0.9.0
Reporter: Ashutosh Chauhan
Assignee: Navis
Priority: Minor
Fix For: 0.9.0
Attachments: HIVE-2686.D1215.1.patch, HIVE-2686.D1215.2.patch,
HIVE-2686.D1215.3.patch
{noformat}
$ ant test -Dtestcase=TestCliDriver -Dqfile=ppr_pushdown.q
[junit] See build/ql/tmp/hive.log, or try ant test ...
-Dtest.silent=false to get more logs.
[junit] at junit.framework.Assert.fail(Assert.java:50)
[junit] at
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppr_pushdown(TestCliDriver.java:129)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at junit.framework.TestCase.runTest(TestCase.java:168)
[junit] at junit.framework.TestCase.runBare(TestCase.java:134)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
[junit] at junit.framework.TestResult.run(TestResult.java:113)
[junit] at junit.framework.TestCase.run(TestCase.java:124)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
[junit] at junit.framework.TestSuite.run(TestSuite.java:238)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
[junit] at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
[junit] 178d177
[junit] 12341234
[junit] 179a179
[junit] 12341234
[junit] 196d195
[junit] 12241224
[junit] 197a197
[junit] 12241224
RE: Not able to create table in hive
Thanks Mark, I do have an access on metastore as I am login as admin. However when I query through Hue web interface it is working for me (using User: Guest). Here is how my hive-site.xml looks like. Is there any property that I need to extend here. property namejavax.jdo.option.ConnectionURL/name valuejdbc:derby:;databaseName=/usr/share/hue/metastore_db;create=true/value descriptionJDBC connect string for a JDBC metastore/description /property property namejavax.jdo.option.ConnectionDriverName/name valueorg.apache.derby.jdbc.EmbeddedDriver/value descriptionDriver class name for a JDBC metastore/description /property property namehive.hwi.war.file/name value/usr/lib/hive/lib/hive-hwi-0.7.0-CDH3B4.war/value descriptionThis is the WAR file with the jsp content for Hive Web Interface/description /property Thank You, Manish -Original Message- From: Mark Grover [mailto:mgro...@oanda.com] Sent: Thursday, February 02, 2012 8:15 PM To: u...@hive.apache.org Subject: Re: Not able to create table in hive Hi Manish, Sounds like a problem with your metastore. Can you verify that you have the access and correct permissions to your metastore? Mark Mark Grover, Business Intelligence Analyst OANDA Corporation www: oanda.com www: fxtrade.com e: mgro...@oanda.com Best Trading Platform - World Finance's Forex Awards 2009. The One to Watch - Treasury Today's Adam Smith Awards 2009. - Original Message - From: Manish.Bhoge manish.bh...@target.com To: u...@hive.apache.org, dev@hive.apache.org Sent: Thursday, February 2, 2012 8:45:26 AM Subject: Not able to create table in hive Hi, I am trying to create a table in Hive using below DDL: CREATE TABLE pokes (foo INT, bar STRING); I am getting below error, I have logged in as admin user : FAILED: Error in metadata: javax.jdo.JDOFatalDataStoreException: Cannot get a connection, pool error Could not create a validated object, cause: A read-only user or a user in a read-only database is not permitted to disable read-only mode on a connection. NestedThrowables: org.apache.commons.dbcp.SQLNestedException: Cannot get a connection, pool error Could not create a validated object, cause: A read-only user or a user in a read-only database is not permitted to disable read-only mode on a connection. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask Any idea? Thank You, Manish
