hello community,
i have build a jar file from my spark app with maven (mvn clean compile
assembly:single) and the following pom file:
project xmlns=http://maven.apache.org/POM/4.0.0; xmlns:xsi=
http://www.w3.org/2001/XMLSchema-instance;
xsi:schemaLocation=http://maven.apache.org/POM/4.0.0
Can you run using spark-submit? What is happening is that you are running a
simple java program -- you've wrapped spark-core in your fat jar but at
runtime you likely need the whole Spark system in order to run your
application. I would mark the spark-core as provided(so you don't wrap it
in your
okay, but how i can compile my app to run this without -Dconfig.file=alt_
reference1.conf?
2015-06-02 15:43 GMT+02:00 Yana Kadiyska yana.kadiy...@gmail.com:
This looks like your app is not finding your Typesafe config. The config
should usually be placed in particular folder under your app to
This looks like your app is not finding your Typesafe config. The config
should usually be placed in particular folder under your app to be seen
correctly. If it's in a non-standard location you can
pass -Dconfig.file=alt_reference1.conf to java to tell it where to look.
If this is a config that
which maven dependency i need, too??
http://www.cloudera.com/content/cloudera/en/documentation/core/v5-2-x/topics/cdh_vd_cdh5_maven_repo.html
Am 02.06.2015 um 16:04 schrieb Yana Kadiyska:
Can you run using spark-submit? What is happening is that you are
running a simple java program -- you've
