And the data remains? If so that is an interesting data point I think. So to mark's point how much data do you have queued up actively in the flow then on that nodes? Number of objects you mention is 3273 files corresponding to 825GB in the content repository. Does NiFi see those 825GB worth of data as being in the flow/queued up? And then if that is the case are we talking about a roughly 1TB repo and so the reported value seems correct and this is simply a case of queueing near to the limit your system can hold?
On Wed, Jun 15, 2016 at 4:24 PM, Ricky Saltzer <ri...@cloudera.com> wrote: > I have two nodes in clustered mode. I have the other node that isn't > filling up as my primary. I've actually already restarted nifi on the node > which has the large repository a few times. > > On Wed, Jun 15, 2016 at 4:22 PM, Joe Witt <joe.w...@gmail.com> wrote: > >> Ricky, >> >> If you restart nifi and then find that it cleans those things up I >> believe then it is related to the defects corrected in the 0.5/0.6 >> timeframe. >> >> Is restarting an option for you at this time. You agree mark? >> >> Thanks >> Joe >> >> On Wed, Jun 15, 2016 at 4:21 PM, Ricky Saltzer <ri...@cloudera.com> wrote: >> > Hey Mark - >> > >> > Thanks for the quick reply! This is our production system so it's >> > unfortunately running 0.4.0. There are currently 3273 files, with some >> > files dating back to May 18th. The content repository itself is 825G. >> > >> > Ricky >> > >> > On Wed, Jun 15, 2016 at 4:17 PM, Mark Payne <marka...@hotmail.com> >> wrote: >> > >> >> Hey Ricky >> >> >> >> The reclaim process is pretty much continuous. What version of NiFi are >> >> you running? >> >> I know there was an issue with this a while back that caused it not to >> >> cleanup properly. >> >> >> >> Also, how much data & how many FlowFiles do you have queued up in your >> >> flow? >> >> Data won't be archived or reclaimed if in the flow. >> >> >> >> Thanks >> >> -Mark >> >> >> >> >> >> >> >> > On Jun 15, 2016, at 4:04 PM, Ricky Saltzer <ri...@cloudera.com> >> wrote: >> >> > >> >> > Hey guys - >> >> > >> >> > I recently discovered I didn't have my "archive.enabled" option set to >> >> true >> >> > after my disk filled up to 95%. I enabled it and then set the >> retention >> >> > period to 12 hours and 50% (default values). However, after restarting >> >> > NiFi, I am not seeing any disk space reclaimed. >> >> > >> >> > I'm curious, is the reclaiming process periodic or continuous? >> >> > >> >> > --- >> >> > ricky >> >> >> >> >> > >> > >> > -- >> > Ricky Saltzer >> > http://www.cloudera.com >> > > > > -- > Ricky Saltzer > http://www.cloudera.com
