Ricky - can't get to that URL, unfortunately. Tells me "This site can't be reached".
May be easier to just copy & paste those particular threads here. Thanks -Mark > On Jun 15, 2016, at 4:36 PM, Ricky Saltzer <ri...@cloudera.com> wrote: > > Looks like the threads are parked and waiting [1] > > [1] > http://github.mtv.cloudera.com/gist/ricky/7a5d89f2eeba58e2206d/raw/0e2b446ca049a8b5f27298c700ac709772d2847c/gistfile1.txt > > On Wed, Jun 15, 2016 at 4:33 PM, Joe Witt <joe.w...@gmail.com> wrote: > >> thanks Ricky - then please take a look at mark's note as that is >> probably more relevant to your case. >> >> On Wed, Jun 15, 2016 at 4:32 PM, Ricky Saltzer <ri...@cloudera.com> wrote: >>> Hey Joe - >>> >>> The NiFi web UI currently reads as: >>> >>> Active threads: 3 >>> Queued: 10,173 / 0 bytes >>> Connected nodes: 2 / 2 >>> Stats last refreshed: 13:31:28 PDT >>> >>> >>> On Wed, Jun 15, 2016 at 4:29 PM, Joe Witt <joe.w...@gmail.com> wrote: >>> >>>> And the data remains? If so that is an interesting data point I >>>> think. So to mark's point how much data do you have queued up >>>> actively in the flow then on that nodes? Number of objects you >>>> mention is 3273 files corresponding to 825GB in the content >>>> repository. Does NiFi see those 825GB worth of data as being in the >>>> flow/queued up? And then if that is the case are we talking about a >>>> roughly 1TB repo and so the reported value seems correct and this is >>>> simply a case of queueing near to the limit your system can hold? >>>> >>>> On Wed, Jun 15, 2016 at 4:24 PM, Ricky Saltzer <ri...@cloudera.com> >> wrote: >>>>> I have two nodes in clustered mode. I have the other node that isn't >>>>> filling up as my primary. I've actually already restarted nifi on the >>>> node >>>>> which has the large repository a few times. >>>>> >>>>> On Wed, Jun 15, 2016 at 4:22 PM, Joe Witt <joe.w...@gmail.com> wrote: >>>>> >>>>>> Ricky, >>>>>> >>>>>> If you restart nifi and then find that it cleans those things up I >>>>>> believe then it is related to the defects corrected in the 0.5/0.6 >>>>>> timeframe. >>>>>> >>>>>> Is restarting an option for you at this time. You agree mark? >>>>>> >>>>>> Thanks >>>>>> Joe >>>>>> >>>>>> On Wed, Jun 15, 2016 at 4:21 PM, Ricky Saltzer <ri...@cloudera.com> >>>> wrote: >>>>>>> Hey Mark - >>>>>>> >>>>>>> Thanks for the quick reply! This is our production system so it's >>>>>>> unfortunately running 0.4.0. There are currently 3273 files, with >> some >>>>>>> files dating back to May 18th. The content repository itself is >> 825G. >>>>>>> >>>>>>> Ricky >>>>>>> >>>>>>> On Wed, Jun 15, 2016 at 4:17 PM, Mark Payne <marka...@hotmail.com> >>>>>> wrote: >>>>>>> >>>>>>>> Hey Ricky >>>>>>>> >>>>>>>> The reclaim process is pretty much continuous. What version of >> NiFi >>>> are >>>>>>>> you running? >>>>>>>> I know there was an issue with this a while back that caused it >> not >>>> to >>>>>>>> cleanup properly. >>>>>>>> >>>>>>>> Also, how much data & how many FlowFiles do you have queued up in >>>> your >>>>>>>> flow? >>>>>>>> Data won't be archived or reclaimed if in the flow. >>>>>>>> >>>>>>>> Thanks >>>>>>>> -Mark >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>>> On Jun 15, 2016, at 4:04 PM, Ricky Saltzer <ri...@cloudera.com> >>>>>> wrote: >>>>>>>>> >>>>>>>>> Hey guys - >>>>>>>>> >>>>>>>>> I recently discovered I didn't have my "archive.enabled" option >>>> set to >>>>>>>> true >>>>>>>>> after my disk filled up to 95%. I enabled it and then set the >>>>>> retention >>>>>>>>> period to 12 hours and 50% (default values). However, after >>>> restarting >>>>>>>>> NiFi, I am not seeing any disk space reclaimed. >>>>>>>>> >>>>>>>>> I'm curious, is the reclaiming process periodic or continuous? >>>>>>>>> >>>>>>>>> --- >>>>>>>>> ricky >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Ricky Saltzer >>>>>>> http://www.cloudera.com >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Ricky Saltzer >>>>> http://www.cloudera.com >>>> >>> >>> >>> >>> -- >>> Ricky Saltzer >>> http://www.cloudera.com >> > > > > -- > Ricky Saltzer > http://www.cloudera.com
