Re: Running Hive Unit Tests from IntelliJ and Datanucleus
Tried that too. Still didn't work for me. Anyway, I'm past that for now. Thanks for the help, Rajat On Wed, Jun 17, 2015 at 7:44 PM, Ruoxi Sun zanmato1...@gmail.com wrote: Hi Rajat, I used an alternative instead of Datanucleus plugin in IntelliJ. Try create a run configuration as the following pictured shows. And make sure you have datanucleus in your module's dependencies. Hope it can help. *孙若曦* 2015-06-18 3:32 GMT+08:00 Rajat Jain rajat...@gmail.com: Hi, I want to run Hive unit tests from IntelliJ but am unable to do so due to datanucleus issues. I tried a lot of options but always seem to be getting the same error. 1. Datanucleus plugin: I installed Datanucleus plugin on IntelliJ, enabled the enhancer but got error of the type: Caused by: org.datanucleus.exceptions.ClassNotPersistableException: The class org.apache.hadoop.hive.metastore.model.MVersionTable is not persistable. This means that it either hasnt been enhanced, or that the enhanced version of the file is not in the CLASSPATH (or is hidden by an unenhanced version), or the Meta-Data/annotations for the class are not found. at org.datanucleus.ExecutionContextImpl.assertClassPersistable(ExecutionContextImpl.java:5698) at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:2123) at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:2065) at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:1913) at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:217) at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:727) ... 66 more When I checked the Datanucleus settings, I noticed that only MDatabase class was registered there and no other classes (like MVersionTable) were registered. Is that the issue? If not, then any way this can be resolved? 2. I tried pushing up the hive-metastore dependency over Module Source as suggested here http://qnalist.com/questions/5105293/running-tests-in-intellij. Didn't work either. I tried this option while both enabling and disabling datanucleus plugin. Let me know if someone has any ideas. I have attached sample screenshots for reference. Thanks, Rajat
Re: hive-1.1.0 - alter table rename issue
from the JIRA comments it looks like there is a miss match between your hive and HMS. Did you upgrade hive recently? On Mon, Jun 22, 2015 at 10:23 AM, Mahesh Sankaran sankarmahes...@gmail.com wrote: Any thoughts regarding this problem?? Mahesh On Sat, Jun 20, 2015 at 10:55 AM, Mahesh Sankaran sankarmahes...@gmail.com wrote: Hi all, I am using hive-1.1.0 and hadoop-2.6.0. am trying to rename a existing table in hive but it shows following error. hive *altertable testrename rename to testrenamebkp ;* *FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid method name: 'alter_table_with_cascade'.* *From this error i followed this jira,* https://issues.apache.org/jira/browse/HIVE-10552 to connect hive with beeline but stills it shows the same error. HADOOP_CONF_DIR=/opt/hadoop-2.6.0/etc/hadoop YARN_CONF_DIR=/opt/hadoop-2.6.0/etc/hadoop /opt/hive/bin/beeline -u jdbc:hive2://hostname:1 username password org.apache.hive.jdbc.HiveDriver Connected to: Apache Hive (version 1.1.0) Driver: Hive JDBC (version 1.1.0) Transaction isolation: TRANSACTION_REPEATABLE_READ Beeline version 1.1.0 by Apache Hive 0: jdbc:hive2://hostname:1 *altertable testrename rename to testrenamebkp ;* *FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid method name: 'alter_table_with_cascade'* Thanks Mahesh.S
Re: hive-1.1.0 - alter table rename issue
Yes i upgraded my hive and HMS recently.but there is no mismatch between hive and HMS. On Mon, Jun 22, 2015 at 10:30 AM, Vishnu Viswanath vishnu.viswanat...@gmail.com wrote: from the JIRA comments it looks like there is a miss match between your hive and HMS. Did you upgrade hive recently? On Mon, Jun 22, 2015 at 10:23 AM, Mahesh Sankaran sankarmahes...@gmail.com wrote: Any thoughts regarding this problem?? Mahesh On Sat, Jun 20, 2015 at 10:55 AM, Mahesh Sankaran sankarmahes...@gmail.com wrote: Hi all, I am using hive-1.1.0 and hadoop-2.6.0. am trying to rename a existing table in hive but it shows following error. hive *altertable testrename rename to testrenamebkp ;* *FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid method name: 'alter_table_with_cascade'.* *From this error i followed this jira,* https://issues.apache.org/jira/browse/HIVE-10552 to connect hive with beeline but stills it shows the same error. HADOOP_CONF_DIR=/opt/hadoop-2.6.0/etc/hadoop YARN_CONF_DIR=/opt/hadoop-2.6.0/etc/hadoop /opt/hive/bin/beeline -u jdbc:hive2://hostname:1 username password org.apache.hive.jdbc.HiveDriver Connected to: Apache Hive (version 1.1.0) Driver: Hive JDBC (version 1.1.0) Transaction isolation: TRANSACTION_REPEATABLE_READ Beeline version 1.1.0 by Apache Hive 0: jdbc:hive2://hostname:1 *altertable testrename rename to testrenamebkp ;* *FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid method name: 'alter_table_with_cascade'* Thanks Mahesh.S
Re: hive-1.1.0 - alter table rename issue
Any thoughts regarding this problem?? Mahesh On Sat, Jun 20, 2015 at 10:55 AM, Mahesh Sankaran sankarmahes...@gmail.com wrote: Hi all, I am using hive-1.1.0 and hadoop-2.6.0. am trying to rename a existing table in hive but it shows following error. hive *altertable testrename rename to testrenamebkp ;* *FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid method name: 'alter_table_with_cascade'.* *From this error i followed this jira,* https://issues.apache.org/jira/browse/HIVE-10552 to connect hive with beeline but stills it shows the same error. HADOOP_CONF_DIR=/opt/hadoop-2.6.0/etc/hadoop YARN_CONF_DIR=/opt/hadoop-2.6.0/etc/hadoop /opt/hive/bin/beeline -u jdbc:hive2://hostname:1 username password org.apache.hive.jdbc.HiveDriver Connected to: Apache Hive (version 1.1.0) Driver: Hive JDBC (version 1.1.0) Transaction isolation: TRANSACTION_REPEATABLE_READ Beeline version 1.1.0 by Apache Hive 0: jdbc:hive2://hostname:1 *altertable testrename rename to testrenamebkp ;* *FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid method name: 'alter_table_with_cascade'* Thanks Mahesh.S
Understanding ORC file format compression
Hi, As per my understanding, the available codecs for ORC file format Hive table compression are either Zlib or Snappy.Both the compression techniques are non splittable.. Does it mean that any queries on Hive table stored as ORC and compressed will not run multiple maps in parallel ??? I know that is not correct, please help me understand what i am missing here... Thanks
