Hi,
How can I include Cassandra-connect-package to Livy spark session?
I use the following spark-submit command/spark-submit --master
spark://10.128.1.1:7077 --packages
datastax:spark-cassandra-connector:2.0.1-s_2.11 --conf
spark.cassandra.connection.host="10.128.1.1,10.128.1.2,10.128.1.3"
how ca
more info regarding the problem.when i pass {"kind":
"pyspark","jars":["datastax:spark-cassandra-connector:2.0.1-s_2.11"]} via post
to /sessionssession status changes to dead. livy logs show this
17/10/09 18:45:15 WARN ContextLauncher: Child process exited
with code 1.17/10/09
Please set "spark.jars.packages" to the package you wanted in batch POST
protocol "conf" field.
Thanks
Jerry
On Tue, Oct 10, 2017 at 3:05 AM, Junaid Nasir wrote:
> more info regarding the problem.
> when i pass {"kind": "pyspark","jars":["datastax:
> spark-cassandra-connector:2.0.1-s_2.11"]} vi