WARN Writing large partition for materialized views

2016-09-28 Thread Robert Sicoie
Hi guys, I run a cluster with 5 nodes, cassandra version 3.0.5. I get this warning: 2016-09-28 17:22:18,480 BigTableWriter.java:171 - Writing large partition... for some materialized view. Some have values over 500MB. How this affects performance? What can/should be done? I suppose is a problem

Re: WARN Writing large partition for materialized views

2016-09-29 Thread Alexander Dejanovski
Hi Robert, Materialized Views are regular C* tables underneath, so based on their PK they can generate big partitions. It is often advised to keep partition size under 100MB because larger partitions are hard to read and compact. They usually put pressure on the heap and lead to long GC pauses +

Re: WARN Writing large partition for materialized views

2016-09-29 Thread Robert Sicoie
Thanks! Robert Sicoie On Thu, Sep 29, 2016 at 12:49 PM, Alexander Dejanovski < a...@thelastpickle.com> wrote: > Hi Robert, > > Materialized Views are regular C* tables underneath, so based on their PK > they can generate big partitions. > It is often advised to keep partition size under 100MB be