Re: Provenance queries effect on processing

2020-11-16 Thread Eric Secules
I dont think this solution would work for me. I am wondering whether the rollover time has any affect on when I am able to query the events. Does the provenance log file need to roll over before it's indexed? On Wed, Nov 4, 2020 at 11:21 AM Bryan Bende wrote: > Not sure if this would be helpful

Re: NiFi on Kubernetes - 2

2020-11-16 Thread Wyll Ingersoll
We deployed a 3-node cluster of nifi containers into a K8S and ran into many of these same issues. We ended up creating our own Docker image based on the upstream apache/nifi image, but with our own entrypoint script that sets the nifi.properties that we wished to customize before launching th

Re: NiFi on Kubernetes - 2

2020-11-16 Thread Sushil Kumar
Hello muhyid72 Thanks for checking in the chart. Yes it leverages usage of helm charts for kubernetes. Regarding the issue you are facing, what you need to understand is that the conf directory on the container would get replaced by volume if you mount, so volume should have pre-existing files. I

Re: NiFi on Kubernetes - 2

2020-11-16 Thread muhyid72
Hi Sushil, Thanks for your interest and knowledge sharing. Sorry for delayed response. I reviewed your chart. As far as I understand, you are using Helm for nifi deployment and you used Helm capabilities. I have not used Helm till now. I would like to use original apache nifi image with minimum ch

Re: NiFi on Kubernetes - 2

2020-11-16 Thread muhyid72
Hi Chris, Thank you for your interest and detailed explanation. Sorry for delayed response. As you explained start.sh script attempts to update nifi.properties file. If I use configmap NiFi Startup is getting the crash because of ConfigMap is read-only and there is no possibility for read/write in