After disabled the client side authorization and no anything in the
SPARK_CLASSPATH, I am still getting no class found error.
property
namehive.security.authorization.enabled/name
valuefalse/value
descriptionPerform authorization checks on the client/description
/property
Am I hitting a
Often java.lang.NoSuchMethodError means that you have more than one version
of a library on your classpath, in this case it looks like hive.
On Thu, Oct 2, 2014 at 8:44 PM, Li HM hmx...@gmail.com wrote:
I have rebuild package with -Phive
Copied hive-site.xml to conf (I am using hive-0.12)
This is my SPARK_CLASSPATH after cleanup
SPARK_CLASSPATH=/home/test/lib/hcatalog-core.jar:$SPARK_CLASSPATH
now use mydb works.
but show tables and select * from test still gives exception:
spark-sql show tables;
OK
java.io.IOException: java.io.IOException: Cannot create an instance of
Why are you including hcatalog-core.jar? That is probably causing the
issues.
On Fri, Oct 3, 2014 at 3:03 PM, Li HM hmx...@gmail.com wrote:
This is my SPARK_CLASSPATH after cleanup
SPARK_CLASSPATH=/home/test/lib/hcatalog-core.jar:$SPARK_CLASSPATH
now use mydb works.
but show tables and
If I don't have that jar, I am getting the following error:
xception in thread main java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.ClassNotFoundException:
org.apache.hcatalog.security.HdfsAuthorizationProvider
at
No, it is hive 0.12.4.
Let me try your suggestion. It is an existing hive db. I am using the original
hive-site.xml as is.
Sent from my iPhone
On Oct 3, 2014, at 5:02 PM, Edwin Chiu edwin.c...@manage.com wrote:
Are you using hive 0.13?
Switching back to HadoopDefaultAuthenticator in
It won't work with valueorg.apache.hadoop.hive.ql.security.
HadoopDefaultAuthenticator/value.
Just wonder how and why it works with you guys.
Here is the new error:
Exception in thread main java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException:
If I change it to
valueorg.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProvider/value
The error becomes:
Exception in thread main java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.RuntimeException: java.lang.NoSuchMethodException:
I have rebuild package with -Phive
Copied hive-site.xml to conf (I am using hive-0.12)
When I run ./bin/spark-sql, I get java.lang.NoSuchMethodError for every
command.
What am I missing here?
Could somebody share what would be the right procedure to make it work?
java.lang.NoSuchMethodError:
