We have all our data in Cassandra so I’d prefer to not have to bring up
Hadoop/HDFS as that’s just another thing that can break.
But I’m reading that spark requires a shared filesystem like HDFS or S3…
Can I use Tachyon or this or something simple for a shared filesystem?
--
Founder/CEO Spinn3
Hi Kevin,
Yes, Spark can read and write to Cassandra without Hadoop. Have you seen
this:
https://github.com/datastax/spark-cassandra-connector
Harold
On Wed, Nov 12, 2014 at 9:28 PM, Kevin Burton wrote:
> We have all our data in Cassandra so I’d prefer to not have to bring up
> Hadoop/HDFS as
Yes. That’s what I was planning on using actually.
I was just curious whether intermediate data had to be kept in HDFS but
this answers my question. thanks.
On Wed, Nov 12, 2014 at 9:33 PM, Harold Nguyen wrote:
> Hi Kevin,
>
> Yes, Spark can read and write to Cassandra without Hadoop. Have yo