Re: How to backup NiFi flow files when running on Kubernetes?

2023-10-24 Thread David Dean via users
> Yes, that's the problem; recommend configuring persistent storage for the >Kubernetes containers running NiFi. I have already configured Persistent Volume Claims (PVC's) for NiFi on Kubernetes. They work fine for persisting data between pod restarts. The problem the limitation of PVCs on

Re: How to backup NiFi flow files when running on Kubernetes?

2023-10-23 Thread Patrick Timmins
"The problem is that our PVCs aren't backed up, nor are they resilient to an availability zone failure. So I'm trying to find a method for backing up the flow files, but I've not found anything for Kubernetes." Yes, that's the problem; recommend configuring persistent storage for the

How to backup NiFi flow files when running on Kubernetes?

2023-10-23 Thread David Dean via users
Hi everyone. I'm running a single instance of NiFi on a Kubernetes cluster using the the Helm chart from Cetic (I can't share the link here, it's on GitHub). This Helm chart uses PVCs for flow file storage, which works fine for persisting flows between restarts of NiFi. The problem is that our