Thanks Cheng.
Here is the error message after a fresh build.
$ mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.5.0 -Phive -DskipTests
clean package
[INFO]
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM
you mind to create a
public gist for your hive-site.xml?
On 10/8/14 4:34 AM, Li HM wrote:
Thanks Cheng.
Here is the error message after a fresh build.
$ mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.5.0 -Phive -DskipTests
clean package
[INFO
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1801)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1893)
... 57 more
On Fri, Oct 3, 2014 at 10:09 PM, Li HM hmx...@gmail.com wrote:
If I change it to
valueorg.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProvider/value
The error
...@databricks.com
wrote:
Often java.lang.NoSuchMethodError means that you have more than one
version of a library on your classpath, in this case it looks like hive.
On Thu, Oct 2, 2014 at 8:44 PM, Li HM hmx...@gmail.com wrote:
I have rebuild package with -Phive
Copied hive-site.xml to conf (I am using
-core.jar? That is probably causing the
issues.
On Fri, Oct 3, 2014 at 3:03 PM, Li HM hmx...@gmail.com wrote:
This is my SPARK_CLASSPATH after cleanup
SPARK_CLASSPATH=/home/test/lib/hcatalog-core.jar:$SPARK_CLASSPATH
now use mydb works.
but show tables and select * from test still gives
/name
!--valueorg.apache.hadoop.hive.ql.security.ProxyUserAuthenticator/value--
valueorg.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator
/value
/property
- Edwin
On Fri, Oct 3, 2014 at 4:25 PM, Li HM hmx...@gmail.com wrote:
If I don't have that jar, I am getting
)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:125)
... 11 more
On Fri, Oct 3, 2014 at 10:05 PM, Li HM hmx...@gmail.com wrote:
It won't work with valueorg.apache.hadoop.hive.ql.security.
HadoopDefaultAuthenticator/value.
Just wonder how and why it works with you guys.
Here
I have rebuild package with -Phive
Copied hive-site.xml to conf (I am using hive-0.12)
When I run ./bin/spark-sql, I get java.lang.NoSuchMethodError for every
command.
What am I missing here?
Could somebody share what would be the right procedure to make it work?
java.lang.NoSuchMethodError:
