Re: Can spark read and write to cassandra without HDFS?

[Kevin Burton]

Yes.  That’s what I was planning on using actually.

I was just curious whether intermediate data had to be kept in HDFS but
this answers my question.  thanks.

On Wed, Nov 12, 2014 at 9:33 PM, Harold Nguyen  wrote:

> Hi Kevin,
>
> Yes, Spark can read and write to Cassandra without Hadoop. Have you seen
> this:
>
> https://github.com/datastax/spark-cassandra-connector
>
> Harold
>
> On Wed, Nov 12, 2014 at 9:28 PM, Kevin Burton  wrote:
>
>> We have all our data in Cassandra so I’d prefer to not have to bring up
>> Hadoop/HDFS as that’s just another thing that can break.
>>
>> But I’m reading that spark requires a shared filesystem like HDFS or S3…
>> Can I use Tachyon or this or something simple for a shared filesystem?
>>
>>
>> --
>>
>> Founder/CEO Spinn3r.com
>> Location: *San Francisco, CA*
>> blog: http://burtonator.wordpress.com
>> … or check out my Google+ profile
>> 
>> 
>>
>>
>


-- 

Founder/CEO Spinn3r.com
Location: *San Francisco, CA*
blog: http://burtonator.wordpress.com
… or check out my Google+ profile

Re: Can spark read and write to cassandra without HDFS?

[Harold Nguyen]

Hi Kevin,

Yes, Spark can read and write to Cassandra without Hadoop. Have you seen
this:

https://github.com/datastax/spark-cassandra-connector

Harold

On Wed, Nov 12, 2014 at 9:28 PM, Kevin Burton  wrote:

> We have all our data in Cassandra so I’d prefer to not have to bring up
> Hadoop/HDFS as that’s just another thing that can break.
>
> But I’m reading that spark requires a shared filesystem like HDFS or S3…
> Can I use Tachyon or this or something simple for a shared filesystem?
>
>
> --
>
> Founder/CEO Spinn3r.com
> Location: *San Francisco, CA*
> blog: http://burtonator.wordpress.com
> … or check out my Google+ profile
> 
> 
>
>

Can spark read and write to cassandra without HDFS?

[Kevin Burton]

We have all our data in Cassandra so I’d prefer to not have to bring up
Hadoop/HDFS as that’s just another thing that can break.

But I’m reading that spark requires a shared filesystem like HDFS or S3…
Can I use Tachyon or this or something simple for a shared filesystem?


-- 

Founder/CEO Spinn3r.com
Location: *San Francisco, CA*
blog: http://burtonator.wordpress.com
… or check out my Google+ profile