Re: Write to Cassandra table from pyspark fails with scala reflect error [RESOLVED]

2016-09-15 Thread Trivedi Amit
There was some environment issue. I basically removed all environment variables and with 2.11 and it worked. Thanks for help. From: Trivedi Amit To: Russell Spitzer ; "user@spark.apache.org" Sent: Thursday, September 15, 2016 9:47 AM Subject: Re: Write to Cassandra

Re: Write to Cassandra table from pyspark fails with scala reflect error

2016-09-15 Thread Trivedi Amit
va gateway process exited before sending the driver its port number``` I deleted my .m2 directory to avoid any conflicts with cached or older versions. I only have SPARK_HOME environment variable set (env variables related to Spark and Python). From: Russell Spitzer To: Trivedi Amit ;

Re: Write to Cassandra table from pyspark fails with scala reflect error

2016-09-14 Thread Trivedi Amit
Hi, I am testing a pyspark program that will read from a csv file and write data into Cassandra table. I am using pyspark with spark-cassandra-connector 2.10:2.0.0-M3. I am using Spark v2.0.0. While executing below command ```df.write.format("org.apache.spark.sql.cassandra").mode('append').o