Hi Ted and Saurahb
If I use —conf arguments with pyspark I am able to connect. Any idea how I
can set these values programmatically? (I work on a notebook server and can
not easily reconfigure the server
This works
extraPkgs="--packages com.databricks:spark-csv_2.11:1.3.0 \
>From cassandra.yaml :
native_transport_port: 9042
FYI
On Tue, Mar 8, 2016 at 9:13 PM, Saurabh Bajaj
wrote:
> Hi Andy,
>
> I believe you need to set the host and port settings separately
> spark.cassandra.connection.host
> spark.cassandra.connection.port
>
>
Hi Andy,
I believe you need to set the host and port settings separately
spark.cassandra.connection.host
spark.cassandra.connection.port
https://github.com/datastax/spark-cassandra-connector/blob/master/doc/reference.md#cassandra-connection-parameters
Looking at the logs, it seems your port
Hi Ted
I believe by default cassandra listens on 9042
From: Ted Yu
Date: Tuesday, March 8, 2016 at 6:11 PM
To: Andrew Davidson
Cc: "user @spark"
Subject: Re: pyspark spark-cassandra-connector java.io.IOException:
Have you contacted spark-cassandra-connector related mailing list ?
I wonder where the port 9042 came from.
Cheers
On Tue, Mar 8, 2016 at 6:02 PM, Andy Davidson wrote:
>
> I am using spark-1.6.0-bin-hadoop2.6. I am trying to write a python
> notebook that reads
I am using spark-1.6.0-bin-hadoop2.6. I am trying to write a python notebook
that reads a data frame from Cassandra.
I connect to cassadra using an ssh tunnel running on port 9043. CQLSH works
how ever I can not figure out how to configure my notebook. I have tried
various hacks any idea what I