Hi,
While trying to connect to Hive using talend 5 'HiveConnection' getting
following error:
Technical details:
Coludera ver CDH3
Apache ver 1
Hive ver 7.0
HDFS
Error:
While connecting it's trying to create directory with the 'windows AD user id'
on hdfs tmp directory, what permissions are required to provide or what is the
solution.
Error details:
=======================================================
[statistics] connecting to socket on port 3338
[statistics] connected
12/07/03 16:49:53 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
12/07/03 16:49:54 INFO metastore.HiveMetaStore: 0: Opening raw store with
implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
12/07/03 16:49:54 INFO metastore.ObjectStore: ObjectStore, initialize called
12/07/03 16:49:54 INFO DataNucleus.Persistence: Property
datanucleus.cache.level2 unknown - will be ignored
12/07/03 16:49:54 INFO DataNucleus.Persistence: Property
javax.jdo.option.NonTransactionalRead unknown - will be ignored
12/07/03 16:49:54 INFO DataNucleus.Persistence: ================= Persistence
Configuration ===============
12/07/03 16:49:54 INFO DataNucleus.Persistence: DataNucleus Persistence Factory
- Vendor: "DataNucleus" Version: "2.0.3"
12/07/03 16:49:54 INFO DataNucleus.Persistence: DataNucleus Persistence Factory
initialised for datastore
URL="jdbc:derby:;databaseName=metastore_db;create=true"
driver="org.apache.derby.jdbc.EmbeddedDriver" userName="APP"
12/07/03 16:49:54 INFO DataNucleus.Persistence:
===========================================================
12/07/03 16:49:57 INFO Datastore.Schema: Initialising Catalog "", Schema "APP"
using "None" auto-start option
12/07/03 16:49:57 INFO Datastore.Schema: Catalog "", Schema "APP" initialised -
managing 0 classes
12/07/03 16:49:57 INFO metastore.ObjectStore: Setting MetaStore object pin
classes with
hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order"
12/07/03 16:49:57 INFO DataNucleus.MetaData: Registering listener for metadata
initialisation
12/07/03 16:49:57 INFO metastore.ObjectStore: Initialized ObjectStore
12/07/03 16:49:58 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 11, column 6 : cvc-elt.1: Cannot find the declaration of element
'jdo'. - Please check your specification of DTD and the validity of the
MetaData XML that you have specified.
12/07/03 16:49:58 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 321, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:58 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 368, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:59 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 390, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:59 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 425, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:59 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 462, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:59 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 503, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:59 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 544, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:59 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 585, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:59 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 630, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:59 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 675, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:49:59 WARN DataNucleus.MetaData: MetaData Parser encountered an
error in file
"jar:file:/D:/Deepak%20Talim/Technical/Talend5/Talend%20Project/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo"
at line 703, column 13 : The content of element type "class" must match
"(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
- Please check your specification of DTD and the validity of the MetaData XML
that you have specified.
12/07/03 16:50:00 INFO DataNucleus.Persistence: Managing Persistence of Class :
org.apache.hadoop.hive.metastore.model.MDatabase [Table : DBS,
InheritanceStrategy : new-table]
12/07/03 16:50:00 INFO DataNucleus.Persistence: Managing Persistence of Field :
org.apache.hadoop.hive.metastore.model.MDatabase.parameters [Table :
DATABASE_PARAMS]
12/07/03 16:50:00 INFO Datastore.Schema: Validating 2 unique key(s) for table
DBS
12/07/03 16:50:00 INFO Datastore.Schema: Validating 0 foreign key(s) for table
DBS
12/07/03 16:50:00 INFO Datastore.Schema: Validating 2 index(es) for table DBS
12/07/03 16:50:00 INFO Datastore.Schema: Validating 1 unique key(s) for table
DATABASE_PARAMS
12/07/03 16:50:00 INFO Datastore.Schema: Validating 1 foreign key(s) for table
DATABASE_PARAMS
12/07/03 16:50:00 INFO Datastore.Schema: Validating 2 index(es) for table
DATABASE_PARAMS
12/07/03 16:50:01 INFO DataNucleus.MetaData: Listener found initialisation for
persistable class org.apache.hadoop.hive.metastore.model.MDatabase
Unable to create log directory /tmp/deepatal
12/07/03 16:50:01 ERROR exec.HiveHistory: Unable to create log directory
/tmp/deepatal
Exception in component tHiveConnection_1
java.lang.RuntimeException: java.io.IOException: The system cannot find the
path specified
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:265)
at
org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.<init>(HiveServer.java:136)
at
org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.<init>(HiveServer.java:121)
at
org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:76)
at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:104)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at
bigdata_demo.connect_hive_0_1.Connect_Hive.tHiveConnection_1Process(Connect_Hive.java:266)
at
bigdata_demo.connect_hive_0_1.Connect_Hive.runJobInTOS(Connect_Hive.java:488)
at bigdata_demo.connect_hive_0_1.Connect_Hive.main(Connect_Hive.java:356)
Caused by: java.io.IOException: The system cannot find the path specified
at java.io.WinNTFileSystem.createFileExclusively(Native Method)
at java.io.File.checkAndCreate(Unknown Source)
at java.io.File.createTempFile(Unknown Source)
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:261)
... 9 more
[statistics] disconnected
=======================================================
Thanks & Regards,
Deepak Talim
Architect | Wipro Technologies | Pune
Phone - VOIP: 8547081 | D: +91 +20 +39132608 | M: +91 98816 90900
Please do not print this email unless it is absolutely necessary.
The information contained in this electronic message and any attachments to
this message are intended for the exclusive use of the addressee(s) and may
contain proprietary, confidential or privileged information. If you are not the
intended recipient, you should not disseminate, distribute or copy this e-mail.
Please notify the sender immediately and destroy all copies of this message and
any attachments.
WARNING: Computer viruses can be transmitted via email. The recipient should
check this email and any attachments for the presence of viruses. The company
accepts no liability for any damage caused by any virus transmitted by this
email.
www.wipro.com
