[jira] [Updated] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Attachment: Hive_bug_3141_resolution.pdf we can provide extra verification for the syntax of select statement to address the issue raised. This would provide an appropriate error message to the user if the syntax is wrong. I have made a change in my local source code which accomplishes this proposed solution . I have attached a screen shot "Hive_bug_3141_resolution.pdf" for reference. > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Attachments: Hive_bug_3141_resolution.pdf > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Attachment: HIVE-3141.1.patch.txt Made change in CliDriver.java to make a check on the syntax of select statement.Please do a code review. The attached screen shot "Hive_bug_3141_resolution.pdf" shows how the select query works after the patch done in my local. > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Attachments: HIVE-3141.1.patch.txt, Hive_bug_3141_resolution.pdf > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Labels: patch (was: ) Affects Version/s: 0.9.0 Status: Patch Available (was: Open) Made change in CliDriver.java to make an extra check on the syntax of select statement. The attached screen shot "Hive_bug_3141_resolution.pdf" shows how the select query works after the patch done in my local > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.1.patch.txt, Hive_bug_3141_resolution.pdf > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430898#comment-13430898 ] Ajesh Kumar commented on HIVE-3141: --- Hi Namit, Both positive and negative tests are included in the attachment "Hive_bug_3141_resolution.pdf". Please let me know if I am missing any specific scenario? thanks > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.1.patch.txt, Hive_bug_3141_resolution.pdf > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Attachment: select_syntax.q.out select_syntax.q Adding q file and q.out file for negative test. > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.1.patch.txt, Hive_bug_3141_resolution.pdf, > select_syntax.q, select_syntax.q.out > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Status: Patch Available (was: Open) Adding q file and q.out file for negative test > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.1.patch.txt, Hive_bug_3141_resolution.pdf, > select_syntax.q, select_syntax.q.out > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Attachment: HIVE-3141.2.patch.txt Adding all changes in a single patch file. HIVE-3141.2.patch.txt > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.1.patch.txt, HIVE-3141.2.patch.txt, > Hive_bug_3141_resolution.pdf, select_syntax.q, select_syntax.q.out > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Status: Patch Available (was: Open) Hi Namit, I have added all the changes in a single patch file, HIVE-3141.2.patch.txt. Please do a review. Because of some software installation limitations, I am not able to install the required software for using Phabricator.So I am not able to create a review for the patch. > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.1.patch.txt, HIVE-3141.2.patch.txt, > Hive_bug_3141_resolution.pdf, select_syntax.q, select_syntax.q.out > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13448582#comment-13448582 ] Ajesh Kumar commented on HIVE-3141: --- Thanks Carl I have added review request in reviews.apache.org. Please find the link for the same https://reviews.apache.org/r/6919/ > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.1.patch.txt, HIVE-3141.2.patch.txt, > Hive_bug_3141_resolution.pdf, select_syntax.q, select_syntax.q.out > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Attachment: (was: HIVE-3141.1.patch.txt) > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.2.patch.txt, Hive_bug_3141_resolution.pdf, > select_syntax.q, select_syntax.q.out > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451895#comment-13451895 ] Ajesh Kumar commented on HIVE-3392: --- All DDL statement are calling Hive.getTable() method which internally invoke checkValidity() method. checkValidity() method internally tries to fetch all the columns using Hive.getFieldsFromDeserializer(getTableName(), getDeserializer()) method. So while trying to drop the table, it tries to get the Deserializer and causes the exception. As a resolution we should bypass the checkValidity() method for drop command. I have tested in local and is working fine. Let me know your comments so that I can work on the patch. > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Natkins > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451927#comment-13451927 ] Ajesh Kumar commented on HIVE-3141: --- Parsing is done in org.apache.hadoop.hive.ql.parse.HiveParser.java. But source code for this file is not available in hadoop distribution. Another option is to modify parse() method in ParseDriver.java to add extra verification for the syntax .All the services like cli,hiveserver uses this method for parsing. Let me know your comments. > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.2.patch.txt, Hive_bug_3141_resolution.pdf, > select_syntax.q, select_syntax.q.out > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Attachment: HIVE-3392.1.patch.txt > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Reporter: Jonathan Natkins > Attachments: HIVE-3392.1.patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Labels: patch (was: ) Affects Version/s: 0.9.0 Status: Patch Available (was: Open) Added logic to skip the table schema validation if the command is a drop command. Attached patch file HIVE-3392.1.patch. Please do a review. > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins > Labels: patch > Attachments: HIVE-3392.1.patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13452722#comment-13452722 ] Ajesh Kumar commented on HIVE-3392: --- Review request added at https://reviews.apache.org/r/7004/ > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins > Labels: patch > Attachments: HIVE-3392.1.patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Attachment: HIVE-3392.Test Case - Before Patch.txt HIVE-3392.Test Case - After Patch.txt HIVE-3392.2.patch.txt > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - After > Patch.txt, HIVE-3392.Test Case - Before Patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Attachment: (was: HIVE-3392.1.patch.txt) > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - After > Patch.txt, HIVE-3392.Test Case - Before Patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Status: Patch Available (was: Open) New Review request added at https://reviews.apache.org/r/7004/diff/3/. As we can not use Junit/.q file for this scenario, I have added testcase in a step by step format. Please review code and Testcases. > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - After > Patch.txt, HIVE-3392.Test Case - Before Patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453736#comment-13453736 ] Ajesh Kumar commented on HIVE-3141: --- Hi Carl, when we execute 'select' query , it is not invoking SemanticAnalyzer.class. Let me know if I am missing something in my analysis. > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Priority: Minor > Labels: patch > Attachments: HIVE-3141.2.patch.txt, Hive_bug_3141_resolution.pdf, > select_syntax.q, select_syntax.q.out > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454625#comment-13454625 ] Ajesh Kumar commented on HIVE-3392: --- Hi Edward Capriolo, when we are dropping a table, why we need to validate the class. We just need to drop the table even if the particular class (which was used while creating the table) is not available. let me know your comments. > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - After > Patch.txt, HIVE-3392.Test Case - Before Patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454626#comment-13454626 ] Ajesh Kumar commented on HIVE-3392: --- Testcases are attached. 1) HIVE-3392.Test Case - Before Patch.txt 2) HIVE-3392.Test Case - After Patch.txt > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - After > Patch.txt, HIVE-3392.Test Case - Before Patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3141) Bug in SELECT query
[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458393#comment-13458393 ] Ajesh Kumar commented on HIVE-3141: --- Hi Carl when we execute 'select' query , it is not invoking SemanticAnalyzer.class. Let me know if I can go ahead with modifying parse() method in ParseDriver.java. > Bug in SELECT query > --- > > Key: HIVE-3141 > URL: https://issues.apache.org/jira/browse/HIVE-3141 > Project: Hive > Issue Type: Bug > Components: CLI >Affects Versions: 0.9.0 > Environment: OS: Ubuntu > Hive version: hive-0.7.1-cdh3u2 > Hadoop : hadoop-0.20.2 >Reporter: ASK >Assignee: Ajesh Kumar >Priority: Minor > Labels: patch > Attachments: HIVE-3141.2.patch.txt, Hive_bug_3141_resolution.pdf, > select_syntax.q, select_syntax.q.out > > > When i try to execute select *(followed by any alphanumeric character) from > table , query is throwing some issues. It display the result for select * > It doesnot happen when only numbers follow the * -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13463858#comment-13463858 ] Ajesh Kumar commented on HIVE-3392: --- Hi Namit, Do I need to change Assignee to get this patch reviewed. > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - After > Patch.txt, HIVE-3392.Test Case - Before Patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464804#comment-13464804 ] Ajesh Kumar commented on HIVE-3392: --- Hi Edward Capriolo, when we are dropping a table, why we need to validate the class. We just need to drop the table even if the particular class (which was used while creating the table) is not available. let me know your comments. > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - After > Patch.txt, HIVE-3392.Test Case - Before Patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13473103#comment-13473103 ] Ajesh Kumar commented on HIVE-3392: --- Hi Edward Capriolo, So can we conclude this as not an issue. or I can make a change to display a message like below when the class is not found. hive> drop table temptbl; FAILED: Hive Internal Error: java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe org.apache.hadoop.hive.serde2.TestDelimitedJSONSerDe does not exist)) hive> > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - After > Patch.txt, HIVE-3392.Test Case - Before Patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Attachment: (was: HIVE-3392.Test Case - After Patch.txt) > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Attachment: (was: HIVE-3392.Test Case - Before Patch.txt) > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3392: -- Attachment: HIVE-3392.Test Case - with_trunk_version.txt Hi Edward Capriolo, I checked the latest version of Driver.java in trunk.(org/apache/hadoop/hive/ql/Driver.java) A lot of patches has been already applied on this file as part of other issue's fixes. The change we have discussed to display a clean error message will be taken care by those changes.So we do not need any more code change for this issue. Attaching a test case for the same."HIVE-3392.Test Case - with_trunk_version.txt". > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - > with_trunk_version.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492219#comment-13492219 ] Ajesh Kumar commented on HIVE-3392: --- Hi Edward Capriolo/Namit As per my previous comment, can you suggest if we need to work more on this or we can consider this issue as resolved? > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - > with_trunk_version.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3392) Hive unnecessarily validates table SerDes when dropping a table
[ https://issues.apache.org/jira/browse/HIVE-3392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498660#comment-13498660 ] Ajesh Kumar commented on HIVE-3392: --- Hi Edward Capriolo As per my previous comment, can you suggest if we need to work more on this or we can consider this issue as resolved? > Hive unnecessarily validates table SerDes when dropping a table > --- > > Key: HIVE-3392 > URL: https://issues.apache.org/jira/browse/HIVE-3392 > Project: Hive > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: Jonathan Natkins >Assignee: Ajesh Kumar > Labels: patch > Attachments: HIVE-3392.2.patch.txt, HIVE-3392.Test Case - > with_trunk_version.txt > > > natty@hadoop1:~$ hive > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> create table test (a int) row format serde 'hive.serde.JSONSerDe'; > > OK > Time taken: 2.399 seconds > natty@hadoop1:~$ hive > hive> drop table test; > > FAILED: Hive Internal Error: > java.lang.RuntimeException(MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe hive.serde.JSONSerDe does not exist)) > java.lang.RuntimeException: > MetaException(message:org.apache.hadoop.hive.serde2.SerDeException SerDe > hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:262) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:253) > at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:490) > at > org.apache.hadoop.hive.ql.metadata.Table.checkValidity(Table.java:162) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:943) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeDropTable(DDLSemanticAnalyzer.java:700) > at > org.apache.hadoop.hive.ql.parse.DDLSemanticAnalyzer.analyzeInternal(DDLSemanticAnalyzer.java:210) > at > org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) > at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) > at > org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) > at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) > at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: MetaException(message:org.apache.hadoop.hive.serde2.SerDeException > SerDe com.cloudera.hive.serde.JSONSerDe does not exist) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:211) > at > org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:260) > ... 20 more > hive> add jar > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar; > Added > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > to class path > Added resource: > /home/natty/source/sample-code/custom-serdes/target/custom-serdes-1.0-SNAPSHOT.jar > hive> drop table test; > OK > Time taken: 0.658 seconds > hive> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3850) hour() function returns 12 hour clock value when using timestamp datatype
[ https://issues.apache.org/jira/browse/HIVE-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566159#comment-13566159 ] Ajesh Kumar commented on HIVE-3850: --- @Arun, Can you use https://reviews.apache.org to create a review for the change? > hour() function returns 12 hour clock value when using timestamp datatype > - > > Key: HIVE-3850 > URL: https://issues.apache.org/jira/browse/HIVE-3850 > Project: Hive > Issue Type: Bug > Components: UDF >Affects Versions: 0.9.0 >Reporter: Pieterjan Vriends > Attachments: HIVE-3850.patch.txt > > > Apparently UDFHour.java does have two evaluate() functions. One that does > accept a Text object as parameter and one that does use a TimeStampWritable > object as parameter. The first function does return the value of > Calendar.HOUR_OF_DAY and the second one of Calendar.HOUR. In the > documentation I couldn't find any information on the overload of the > evaluation function. I did spent quite some time finding out why my statement > didn't return a 24 hour clock value. > Shouldn't both functions return the same? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
