Can spark read and write to cassandra without HDFS?

2014-11-12 Thread Kevin Burton
We have all our data in Cassandra so I’d prefer to not have to bring up Hadoop/HDFS as that’s just another thing that can break. But I’m reading that spark requires a shared filesystem like HDFS or S3… Can I use Tachyon or this or something simple for a shared filesystem? -- Founder/CEO

Re: Can spark read and write to cassandra without HDFS?

2014-11-12 Thread Harold Nguyen
Hi Kevin, Yes, Spark can read and write to Cassandra without Hadoop. Have you seen this: https://github.com/datastax/spark-cassandra-connector Harold On Wed, Nov 12, 2014 at 9:28 PM, Kevin Burton bur...@spinn3r.com wrote: We have all our data in Cassandra so I’d prefer to not have to bring

Re: Can spark read and write to cassandra without HDFS?

2014-11-12 Thread Kevin Burton
Yes. That’s what I was planning on using actually. I was just curious whether intermediate data had to be kept in HDFS but this answers my question. thanks. On Wed, Nov 12, 2014 at 9:33 PM, Harold Nguyen har...@nexgate.com wrote: Hi Kevin, Yes, Spark can read and write to Cassandra without