It is definitely best to try to keep those in sync, but that won't affect this, as the NCM isn't involved in the nodes' internal maintenance, etc.
> On Jun 15, 2016, at 4:38 PM, Ricky Saltzer <ri...@cloudera.com> wrote: > > I should also mention, I just realized that our worker nodes are on 0.5.1, > and for some reason I missed updating the master from 0.4.0. I'm sure that > is not helping. > > On Wed, Jun 15, 2016 at 4:36 PM, Ricky Saltzer <ri...@cloudera.com> wrote: > >> Looks like the threads are parked and waiting [1] >> >> [1] >> http://github.mtv.cloudera.com/gist/ricky/7a5d89f2eeba58e2206d/raw/0e2b446ca049a8b5f27298c700ac709772d2847c/gistfile1.txt >> >> On Wed, Jun 15, 2016 at 4:33 PM, Joe Witt <joe.w...@gmail.com> wrote: >> >>> thanks Ricky - then please take a look at mark's note as that is >>> probably more relevant to your case. >>> >>> On Wed, Jun 15, 2016 at 4:32 PM, Ricky Saltzer <ri...@cloudera.com> >>> wrote: >>>> Hey Joe - >>>> >>>> The NiFi web UI currently reads as: >>>> >>>> Active threads: 3 >>>> Queued: 10,173 / 0 bytes >>>> Connected nodes: 2 / 2 >>>> Stats last refreshed: 13:31:28 PDT >>>> >>>> >>>> On Wed, Jun 15, 2016 at 4:29 PM, Joe Witt <joe.w...@gmail.com> wrote: >>>> >>>>> And the data remains? If so that is an interesting data point I >>>>> think. So to mark's point how much data do you have queued up >>>>> actively in the flow then on that nodes? Number of objects you >>>>> mention is 3273 files corresponding to 825GB in the content >>>>> repository. Does NiFi see those 825GB worth of data as being in the >>>>> flow/queued up? And then if that is the case are we talking about a >>>>> roughly 1TB repo and so the reported value seems correct and this is >>>>> simply a case of queueing near to the limit your system can hold? >>>>> >>>>> On Wed, Jun 15, 2016 at 4:24 PM, Ricky Saltzer <ri...@cloudera.com> >>> wrote: >>>>>> I have two nodes in clustered mode. I have the other node that isn't >>>>>> filling up as my primary. I've actually already restarted nifi on the >>>>> node >>>>>> which has the large repository a few times. >>>>>> >>>>>> On Wed, Jun 15, 2016 at 4:22 PM, Joe Witt <joe.w...@gmail.com> >>> wrote: >>>>>> >>>>>>> Ricky, >>>>>>> >>>>>>> If you restart nifi and then find that it cleans those things up I >>>>>>> believe then it is related to the defects corrected in the 0.5/0.6 >>>>>>> timeframe. >>>>>>> >>>>>>> Is restarting an option for you at this time. You agree mark? >>>>>>> >>>>>>> Thanks >>>>>>> Joe >>>>>>> >>>>>>> On Wed, Jun 15, 2016 at 4:21 PM, Ricky Saltzer <ri...@cloudera.com> >>>>> wrote: >>>>>>>> Hey Mark - >>>>>>>> >>>>>>>> Thanks for the quick reply! This is our production system so it's >>>>>>>> unfortunately running 0.4.0. There are currently 3273 files, with >>> some >>>>>>>> files dating back to May 18th. The content repository itself is >>> 825G. >>>>>>>> >>>>>>>> Ricky >>>>>>>> >>>>>>>> On Wed, Jun 15, 2016 at 4:17 PM, Mark Payne <marka...@hotmail.com >>>> >>>>>>> wrote: >>>>>>>> >>>>>>>>> Hey Ricky >>>>>>>>> >>>>>>>>> The reclaim process is pretty much continuous. What version of >>> NiFi >>>>> are >>>>>>>>> you running? >>>>>>>>> I know there was an issue with this a while back that caused it >>> not >>>>> to >>>>>>>>> cleanup properly. >>>>>>>>> >>>>>>>>> Also, how much data & how many FlowFiles do you have queued up in >>>>> your >>>>>>>>> flow? >>>>>>>>> Data won't be archived or reclaimed if in the flow. >>>>>>>>> >>>>>>>>> Thanks >>>>>>>>> -Mark >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>>> On Jun 15, 2016, at 4:04 PM, Ricky Saltzer <ri...@cloudera.com >>>> >>>>>>> wrote: >>>>>>>>>> >>>>>>>>>> Hey guys - >>>>>>>>>> >>>>>>>>>> I recently discovered I didn't have my "archive.enabled" option >>>>> set to >>>>>>>>> true >>>>>>>>>> after my disk filled up to 95%. I enabled it and then set the >>>>>>> retention >>>>>>>>>> period to 12 hours and 50% (default values). However, after >>>>> restarting >>>>>>>>>> NiFi, I am not seeing any disk space reclaimed. >>>>>>>>>> >>>>>>>>>> I'm curious, is the reclaiming process periodic or continuous? >>>>>>>>>> >>>>>>>>>> --- >>>>>>>>>> ricky >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Ricky Saltzer >>>>>>>> http://www.cloudera.com >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Ricky Saltzer >>>>>> http://www.cloudera.com >>>>> >>>> >>>> >>>> >>>> -- >>>> Ricky Saltzer >>>> http://www.cloudera.com >>> >> >> >> >> -- >> Ricky Saltzer >> http://www.cloudera.com >> >> > > > -- > Ricky Saltzer > http://www.cloudera.com
