ct: Re: Using Spark to delete from Transactional Cluster
Yes agree on “let really old data expire” . However, I could not find a way to
TTL an entire row. Only columns can be TTLed.
Charu
From: Rahul Singh <rahul.xavier.si...@gmail.com>
Reply-To: "user@cassandra.
8 at 1:45 PM
To: "user@cassandra.apache.org" <user@cassandra.apache.org>,
"user@cassandra.apache.org" <user@cassandra.apache.org>
Subject: Re: Using Spark to delete from Transactional Cluster
I think there are better ways to leverage parallel processing than to use
dra.apache.org" <user@cassandra.apache.org>,
> "user@cassandra.apache.org" <user@cassandra.apache.org>
> Subject: Re: Using Spark to delete from Transactional Cluster
>
> Short answer : it works. You can even run “delete” statements from within
> Spark once y
.org" <user@cassandra.apache.org>
Date: Friday, March 23, 2018 at 12:10 PM
To: "user@cassandra.apache.org" <user@cassandra.apache.org>
Subject: Re: Using Spark to delete from Transactional Cluster
I'm confused as to what the difference between deleting with prepared
ul.xavier.si...@gmail.com>
>> Reply-To: "user@cassandra.apache.org" <user@cassandra.apache.org>
>> Date: Thursday, March 22, 2018 at 5:08 PM
>> To: "user@cassandra.apache.org" <user@cassandra.apache.org>,
>> "user@cassandra.apache.org&quo
> Thanks,
>
> Charu
>
>
>
> *From: *Rahul Singh <rahul.xavier.si...@gmail.com>
> *Reply-To: *"user@cassandra.apache.org" <user@cassandra.apache.org>
> *Date: *Thursday, March 22, 2018 at 5:08 PM
> *To: *"user@cassandra.apache.org" <user@cassand
ch 22, 2018 at 5:08 PM
To: "user@cassandra.apache.org" <user@cassandra.apache.org>,
"user@cassandra.apache.org" <user@cassandra.apache.org>
Subject: Re: Using Spark to delete from Transactional Cluster
Short answer : it works. You can even run “delete” statements
Short answer : it works. You can even run “delete” statements from within Spark
once you know which keys to delete. Not elegant but it works.
It will create a bunch of tombstones and you may need to spread your deletes
over days. Another thing to consider is instead of deleting setting a TTL
Hi,
Wanted to know the community’s experiences and feedback on using Apache
Spark to delete data from C* transactional cluster.
We have spark installed in our analytical C* cluster and so far we have been
using Spark only for analytics purposes.
However, now with advanced features of Spark