Re: Using Spark to delete from Transactional Cluster

2018-03-24 Thread Jacques-Henri Berthemet
ct: Re: Using Spark to delete from Transactional Cluster Yes agree on “let really old data expire” . However, I could not find a way to TTL an entire row. Only columns can be TTLed. Charu From: Rahul Singh <rahul.xavier.si...@gmail.com> Reply-To: "user@cassandra.

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Charulata Sharma (charshar)
8 at 1:45 PM To: "user@cassandra.apache.org" <user@cassandra.apache.org>, "user@cassandra.apache.org" <user@cassandra.apache.org> Subject: Re: Using Spark to delete from Transactional Cluster I think there are better ways to leverage parallel processing than to use

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Rahul Singh
dra.apache.org" <user@cassandra.apache.org>, > "user@cassandra.apache.org" <user@cassandra.apache.org> > Subject: Re: Using Spark to delete from Transactional Cluster > > Short answer : it works. You can even run “delete” statements from within > Spark once y

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Charulata Sharma (charshar)
.org" <user@cassandra.apache.org> Date: Friday, March 23, 2018 at 12:10 PM To: "user@cassandra.apache.org" <user@cassandra.apache.org> Subject: Re: Using Spark to delete from Transactional Cluster I'm confused as to what the difference between deleting with prepared

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Nitan Kainth
ul.xavier.si...@gmail.com> >> Reply-To: "user@cassandra.apache.org" <user@cassandra.apache.org> >> Date: Thursday, March 22, 2018 at 5:08 PM >> To: "user@cassandra.apache.org" <user@cassandra.apache.org>, >> "user@cassandra.apache.org&quo

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Jonathan Haddad
> Thanks, > > Charu > > > > *From: *Rahul Singh <rahul.xavier.si...@gmail.com> > *Reply-To: *"user@cassandra.apache.org" <user@cassandra.apache.org> > *Date: *Thursday, March 22, 2018 at 5:08 PM > *To: *"user@cassandra.apache.org" <user@cassand

Re: Using Spark to delete from Transactional Cluster

2018-03-23 Thread Charulata Sharma (charshar)
ch 22, 2018 at 5:08 PM To: "user@cassandra.apache.org" <user@cassandra.apache.org>, "user@cassandra.apache.org" <user@cassandra.apache.org> Subject: Re: Using Spark to delete from Transactional Cluster Short answer : it works. You can even run “delete” statements

Re: Using Spark to delete from Transactional Cluster

2018-03-22 Thread Rahul Singh
Short answer : it works. You can even run “delete” statements from within Spark once you know which keys to delete. Not elegant but it works. It will create a bunch of tombstones and you may need to spread your deletes over days. Another thing to consider is instead of deleting setting a TTL

Using Spark to delete from Transactional Cluster

2018-03-22 Thread Charulata Sharma (charshar)
Hi, Wanted to know the community’s experiences and feedback on using Apache Spark to delete data from C* transactional cluster. We have spark installed in our analytical C* cluster and so far we have been using Spark only for analytics purposes. However, now with advanced features of Spark