Re: Repair daily refreshed table

2018-08-18 Thread Rahul Singh
Are you loading using a batch process? What’s the frequency of the data Ingest 
and does it have to very fast. If not too frequent and can be a little slower, 
you may consider a higher consistency to ensure data is on replicas.

Rahul
On Aug 18, 2018, 2:29 AM -0700, Maxim Parkachov , wrote:
> Hi community,
>
> I'm currently puzzled with following challenge. I have a CF with 7 days TTL 
> on all rows. Daily there is a process which loads actual data with +7 days 
> TTL. Thus records which are not present in last 7 days of load expired. 
> Amount of these expired records are very small < 1%. I have daily repair 
> process, which take considerable amount of time and resources, and snapshot 
> after that. Obviously I'm concerned only with the last loaded data. 
> Basically, my question: should I run repair before load, after load or maybe 
> I don't need to repair such table at all ?
>
> Regards,
> Maxim.


Repair daily refreshed table

2018-08-18 Thread Maxim Parkachov
Hi community,

I'm currently puzzled with following challenge. I have a CF with 7 days TTL
on all rows. Daily there is a process which loads actual data with +7 days
TTL. Thus records which are not present in last 7 days of load expired.
Amount of these expired records are very small < 1%. I have daily repair
process, which take considerable amount of time and resources, and snapshot
after that. Obviously I'm concerned only with the last loaded data.
Basically, my question: should I run repair before load, after load or
maybe I don't need to repair such table at all ?

Regards,
Maxim.