RE: how to setup nifi.content.repository.archive.max.retention.period in a Nifi docker image ?
Hi Breno.
Thanks for your feedback.
I think I will override the nifi image by adding my own entrypoint ( which will
call the nifi start.sh at the end)
In my entrypoint, I will call another script that will mimic the nifi
script.sh. In this new script , I will add something like :
prop_replace 'nifi.content.repository.archive.max.retention.period'
"${NIFI_CONTENT_REPOSITORY_ARCHIVE_MAX_RETENTION_PERIOD:-'12 hours"}"
Regards
From: Breno Cesar
Sent: Tuesday, February 22, 2022 3:07 PM
To: users@nifi.apache.org
Subject: Re: how to setup nifi.content.repository.archive.max.retention.period
in a Nifi docker image ?
CAUTION: External Email : Be wary of clicking links or if this claims to be
internal.
Hi Nicolas,
As far as i know, there is no variable for this config.The documentation has a
lack about this topic and does not explain about it.
Doing some "googling", i found that someone already maped this variables.
https://github.com/dprophet/nifi/blob/master/nifi-docker/dockerhub/CONFIGURATION.md<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fdprophet%2Fnifi%2Fblob%2Fmaster%2Fnifi-docker%2Fdockerhub%2FCONFIGURATION.md=04%7C01%7Cnbelot%40infovista.com%7C9d7b2b54bc1c49e25d8308d9f60ca55f%7Cc8d853de982e440492ffb4189dc94e37%7C0%7C0%7C637811356471583447%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000=IRvhcPqQz2gYCRz5bRiVQCp%2F7JhRz5I9GJY6m6iSsXg%3D=0>
Assuming this configuration you need is a tunnig, and will not be done
frequenly, as far as I know, you can change it in the default nifi files on a
clean docker image, and export it for later use.
Breno
Em ter., 22 de fev. de 2022 às 10:01, Nicolas Belot
mailto:nbe...@infovista.com>> escreveu:
Hello everyone.
I use a docker image of nifi and I need to tune
nifi.content.repository.archive.max.retention.period.
Is there a way to simply set it up through an env variable ?
I read the start.sh script but
nifi.content.repository.archive.max.retention.period does not appear in this
script.
Regards
N.
Re: how to setup nifi.content.repository.archive.max.retention.period in a Nifi docker image ?
Breno, While we're on this topic, what's best practice for changing something like "the default nifi files on a clean docker image, ..."? Use sed or awk from a RUN command? (This is really a Docker question, but you raised it. Anything you suggest would be helpful.) Russ On 2/22/22 07:07, Breno Cesar wrote: Hi Nicolas, As far as i know, there is no variable for this config.The documentation has a lack about this topic and does not explain about it. Doing some "googling", i found that someone already maped this variables. https://github.com/dprophet/nifi/blob/master/nifi-docker/dockerhub/CONFIGURATION.md Assuming this configuration you need is a tunnig, and will not be done frequenly, as far as I know, you can change it in the default nifi files on a clean docker image, and export it for later use. *Breno * Em ter., 22 de fev. de 2022 às 10:01, Nicolas Belot escreveu: Hello everyone. I use a docker image of nifi and I need to tune nifi.content.repository.archive.max.retention.period. Is there a way to simply set it up through an env variable ? I read the start.sh script but nifi.content.repository.archive.max.retention.period does not appear in this script. Regards N.
Re: how to setup nifi.content.repository.archive.max.retention.period in a Nifi docker image ?
Hi Nicolas, As far as i know, there is no variable for this config.The documentation has a lack about this topic and does not explain about it. Doing some "googling", i found that someone already maped this variables. https://github.com/dprophet/nifi/blob/master/nifi-docker/dockerhub/CONFIGURATION.md Assuming this configuration you need is a tunnig, and will not be done frequenly, as far as I know, you can change it in the default nifi files on a clean docker image, and export it for later use. *Breno * Em ter., 22 de fev. de 2022 às 10:01, Nicolas Belot escreveu: > Hello everyone. > > > > I use a docker image of nifi and I need to tune > nifi.content.repository.archive.max.retention.period. > > > > Is there a way to simply set it up through an env variable ? > > > > I read the start.sh script but > nifi.content.repository.archive.max.retention.period does not appear in > this script. > > > > Regards > > > > N. > > >
how to setup nifi.content.repository.archive.max.retention.period in a Nifi docker image ?
Hello everyone. I use a docker image of nifi and I need to tune nifi.content.repository.archive.max.retention.period. Is there a way to simply set it up through an env variable ? I read the start.sh script but nifi.content.repository.archive.max.retention.period does not appear in this script. Regards N.
Re: nifi.content.repository.archive.max.retention.period
Andre, Sorry this got lost in the mail pile. Your assumptions are correct and that is the anticipated behavior. Has this been a reproducible and/or persistent issue (the lack of archiving causes disk consumption to grow unbounded)? If so, any level of context you can provide to the flow such as extensions may help to dive in a bit more. Thanks! On Tue, Mar 22, 2016 at 8:07 PM, Andre <andre-li...@fucs.org> wrote: > Hi there, > > I have a testing instance of nifi 0.4.2 running an I've noticed a very > strange behaviour around content archives > > When I look I my settings I see: > > # Content Repository > > nifi.content.repository.implementation=org.apache.nifi.controller.repository.Fil > eSystemRepository > nifi.content.claim.max.appendable.size=10 MB > nifi.content.claim.max.flow.files=100 > nifi.content.repository.directory.default=./repositories/content_repository > nifi.content.repository.archive.max.retention.period=12 hours > nifi.content.repository.archive.max.usage.percentage=50% > nifi.content.repository.archive.enabled=true > nifi.content.repository.always.sync=false > nifi.content.viewer.url=/nifi-content-viewer/ > > > Yet, when looking at the archives I can see data that is days older than > the retention period (as an example, some of the data I have is quite old > (we didn't see much data crossing that instance so the issue was never > detected) but we had some changes last week and that became more evident. > > Am I correct to assume NiFi should have cleaned archives older than 12 > hours? > > Cheers >
nifi.content.repository.archive.max.retention.period
Hi there, I have a testing instance of nifi 0.4.2 running an I've noticed a very strange behaviour around content archives When I look I my settings I see: # Content Repository nifi.content.repository.implementation=org.apache.nifi.controller.repository.Fil eSystemRepository nifi.content.claim.max.appendable.size=10 MB nifi.content.claim.max.flow.files=100 nifi.content.repository.directory.default=./repositories/content_repository nifi.content.repository.archive.max.retention.period=12 hours nifi.content.repository.archive.max.usage.percentage=50% nifi.content.repository.archive.enabled=true nifi.content.repository.always.sync=false nifi.content.viewer.url=/nifi-content-viewer/ Yet, when looking at the archives I can see data that is days older than the retention period (as an example, some of the data I have is quite old (we didn't see much data crossing that instance so the issue was never detected) but we had some changes last week and that became more evident. Am I correct to assume NiFi should have cleaned archives older than 12 hours? Cheers
