FAILED: Error in metadata
Hi all, my hive-site.xml is property namejavax.jdo.option.ConnectionURL/name valuejdbc:mysql://127.0.0.1:3306/try?createDatabaseIfNotExist=true/value /property property namejavax.jdo.option.ConnectionDriverName/name valuecom.mysql.jdbc.Driver/value /property property namejavax.jdo.option.ConnectionUserName/name valuehadoop/value /property property namejavax.jdo.option.ConnectionPassword/name valuehadoop/value /property and created a user in my sql. CREATE USER 'hadoop'@'localhost' IDENTIFIED BY 'hadoop'; GRANT ALL PRIVILEGES ON *.* TO 'hadoop' WITH GRANT OPTION; Schema name is try, and connection name is Demo When I run hive in single terminal then it runs fine but when i try to run hive parallel on new terminal window it shows the error: FAILED: Error in metadata: javax.jdo.JDOFatalDataStoreException: Failed to start database 'metastore_db', see the next exception for details. NestedThrowables: java.sql.SQLException: Failed to start database 'metastore_db', see the next exception for details. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask Please help and suggest Yogesh Kumar
Re: FAILED: Error in metadata
Hi Yogesh It looks like hive is still on the derby db . Can you restart your hive instances after updating the hive-site.xml. Also please make sure that you are modifying the right copy of the file. Regards, Bejoy KS From: yogesh dhari yogeshdh...@live.com To: hive request user@hive.apache.org Sent: Sunday, September 9, 2012 2:21 PM Subject: FAILED: Error in metadata Hi all, my hive-site.xml is property namejavax.jdo.option.ConnectionURL/name valuejdbc:mysql://127.0.0.1:3306/try?createDatabaseIfNotExist=true/value /property property namejavax.jdo.option.ConnectionDriverName/name valuecom.mysql.jdbc.Driver/value /property property namejavax.jdo.option.ConnectionUserName/name valuehadoop/value /property property namejavax.jdo.option.ConnectionPassword/name valuehadoop/value /property and created a user in my sql. CREATE USER 'hadoop'@'localhost' IDENTIFIED BY 'hadoop'; GRANT ALL PRIVILEGES ON *.* TO 'hadoop' WITH GRANT OPTION; Schema name is try, and connection name is Demo When I run hive in single terminal then it runs fine but when i try to run hive parallel on new terminal window it shows the error: FAILED: Error in metadata: javax.jdo.JDOFatalDataStoreException: Failed to start database 'metastore_db', see the next exception for details. NestedThrowables: java.sql.SQLException: Failed to start database 'metastore_db', see the next exception for details. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask Please help and suggest Yogesh Kumar
hive table missing
Hi, We are seeing a hive table is gone unexpectedly. I suspect that this must have been caused by someone somewhere issuing a drop table command.But it's unclear. My question is : are there other known ways for hive to lose a table besides drop table. For example, let's say that the underlying hdfs file system is having some trouble, it is unreachable for a few minutes, maybe hive could think I don't see the hdfs files I need for this table. I will assume the user wishes to delete the table. And then it proceeds to cause an automatic deletion. That would certainly be terrible. :-) But I hope you see what I am getting at..Other ways which might cause a table to be lost, besides someone typing in the drop table command in a hive session. Thanks, Sam
Re: hive table missing
Hi Sam Hive table details are on he metastore db and would be gone only if that entry is deleted. That is on a drop command normally. Hive table will be there even if there is no data corresponding to the storage location. Infact it'd be there even if the store location doesn't exists. Regards Bejoy KS Sent from handheld, please excuse typos. -Original Message- From: Sam Darwin samuel.d.dar...@gmail.com Date: Sun, 9 Sep 2012 12:49:14 To: user@hive.apache.org Reply-To: user@hive.apache.org Subject: hive table missing Hi, We are seeing a hive table is gone unexpectedly. I suspect that this must have been caused by someone somewhere issuing a drop table command.But it's unclear. My question is : are there other known ways for hive to lose a table besides drop table. For example, let's say that the underlying hdfs file system is having some trouble, it is unreachable for a few minutes, maybe hive could think I don't see the hdfs files I need for this table. I will assume the user wishes to delete the table. And then it proceeds to cause an automatic deletion. That would certainly be terrible. :-) But I hope you see what I am getting at..Other ways which might cause a table to be lost, besides someone typing in the drop table command in a hive session. Thanks, Sam
RE: FAILED: Error in metadata
Helli Bejoy, I have restarted the hive and all cluster again but still the same issue. Please help me out Thanks regards Yogesh Kumar Date: Sun, 9 Sep 2012 02:21:47 -0700 From: bejoy...@yahoo.com Subject: Re: FAILED: Error in metadata To: user@hive.apache.org Hi Yogesh It looks like hive is still on the derby db . Can you restart your hive instances after updating the hive-site.xml. Also please make sure that you are modifying the right copy of the file. Regards,Bejoy KS From: yogesh dhari yogeshdh...@live.com To: hive request user@hive.apache.org Sent: Sunday, September 9, 2012 2:21 PM Subject: FAILED: Error in metadata Hi all, my hive-site.xml is property namejavax.jdo.option.ConnectionURL/name valuejdbc:mysql://127.0.0.1:3306/try?createDatabaseIfNotExist=true/value /property property namejavax.jdo.option.ConnectionDriverName/name valuecom.mysql.jdbc.Driver/value /property property namejavax.jdo.option.ConnectionUserName/name valuehadoop/value /property property namejavax.jdo.option.ConnectionPassword/name valuehadoop/value /property and created a user in my sql. CREATE USER 'hadoop'@'localhost' IDENTIFIED BY 'hadoop'; GRANT ALL PRIVILEGES ON *.* TO 'hadoop' WITH GRANT OPTION; Schema name is try, and connection name is Demo When I run hive in single terminal then it runs fine but when i try to run hive parallel on new terminal window it shows the error: FAILED: Error in metadata: javax.jdo.JDOFatalDataStoreException: Failed to start database 'metastore_db', see the next exception for details. NestedThrowables: java.sql.SQLException: Failed to start database 'metastore_db', see the next exception for details. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask Please help and suggest Yogesh Kumar
Where does hive store join query results
Hi Everyone, I am running a join query on two tables in hive. When I run the join query, hive runs a map-reduce job.I can't seem to find the results of the join query. Can someone tell me where hive stores the results of the join query. Thanks Rajesh Kumar
Re: Where does hive store join query results
maybe there is empty ouput.if you can see ok in your consol,hive has already output the result. 2012/9/10 rajesh.ba...@orkash.com rajesh.ba...@orkash.com Hi Everyone, I am running a join query on two tables in hive. When I run the join query, hive runs a map-reduce job.I can't seem to find the results of the join query. Can someone tell me where hive stores the results of the join query. Thanks Rajesh Kumar
Re: FAILED: Error in metadata
check your mysql first, if you can see some tables like TBLS,COLUMNS, the mysql should work fine. otherwise you should check your configuration about the hive-site.xml 2012/9/10 yogesh dhari yogeshdh...@live.com Helli Bejoy, I have restarted the hive and all cluster again but still the same issue. Please help me out Thanks regards Yogesh Kumar -- Date: Sun, 9 Sep 2012 02:21:47 -0700 From: bejoy...@yahoo.com Subject: Re: FAILED: Error in metadata To: user@hive.apache.org Hi Yogesh It looks like hive is still on the derby db . Can you restart your hive instances after updating the hive-site.xml. Also please make sure that you are modifying the right copy of the file. Regards, Bejoy KS -- *From:* yogesh dhari yogeshdh...@live.com *To:* hive request user@hive.apache.org *Sent:* Sunday, September 9, 2012 2:21 PM *Subject:* FAILED: Error in metadata Hi all, my hive-site.xml is property namejavax.jdo.option.ConnectionURL/name valuejdbc:mysql:// 127.0.0.1:3306/try?createDatabaseIfNotExist=true/value /property property namejavax.jdo.option.ConnectionDriverName/name valuecom.mysql.jdbc.Driver/value /property property namejavax.jdo.option.ConnectionUserName/name valuehadoop/value /property property namejavax.jdo.option.ConnectionPassword/name valuehadoop/value /property and created a user in my sql. CREATE USER 'hadoop'@'localhost' IDENTIFIED BY 'hadoop'; GRANT ALL PRIVILEGES ON *.* TO 'hadoop' WITH GRANT OPTION; Schema name is try, and connection name is Demo When I run hive in single terminal then it runs fine but when i try to run hive parallel on new terminal window it shows the error: FAILED: Error in metadata: javax.jdo.JDOFatalDataStoreException: Failed to start database 'metastore_db', see the next exception for details. NestedThrowables: java.sql.SQLException: Failed to start database 'metastore_db', see the next exception for details. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask Please help and suggest Yogesh Kumar
Re: Where does hive store join query results
Hi Rajesh If you like to store the results of some hive query in a directory you need to use query like INSERT OVERWRITE [LOCAL] DIRECTORY 'fs location' 'your query 'https://cwiki.apache.org/Hive/languagemanual-dml.html#LanguageManualDML-Writingdataintofilesystemfromqueries If a directory is not specified then the results of the query is just printed on the CLI. Regards, Bejoy KS From: Hongjie Guo hongjie...@gmail.com To: user@hive.apache.org Sent: Monday, September 10, 2012 10:10 AM Subject: Re: Where does hive store join query results maybe there is empty ouput.if you can see ok in your consol,hive has already output the result. 2012/9/10 rajesh.ba...@orkash.com rajesh.ba...@orkash.com Hi Everyone, I am running a join query on two tables in hive. When I run the join query, hive runs a map-reduce job.I can't seem to find the results of the join query. Can someone tell me where hive stores the results of the join query. Thanks Rajesh Kumar
