Re: Need Help in migrating Giant CSV from S3 to SFTP

2023-05-09 Thread Joe Witt
Nilesh, These processors generally are not memory sensitive as they should only ever have small amounts in memory at a time so it is likely this should work well up to 100s of GB objects and so on. We of course dont really test that much but it is technically reasonable and designed as such. So

Re: Need Help in migrating Giant CSV from S3 to SFTP

2023-05-09 Thread Eric Secules
Hi Nilesh, Based on that graph, I think each node in your cluster only has 173GB of content storage. It makes sense that you're having trouble transferring files greater than 100GB. Depending on the node it's assigned to and what else is going on in the cluster it may not be able to evict enough

RE: Need Help in migrating Giant CSV from S3 to SFTP

2023-05-09 Thread Kumar, Nilesh via users
Hi Eric I see following for my content Repository. Can you please help me on how to tweak it further. I have deployed nifi on K8s with 3 replica pod cluster, with no limit of resource. But I guess the pod cpu/memory will be throttled by node capacity itself. I noticed that single I have one

issue in Migrating a template from one server to another

2023-05-09 Thread Urmila Pal
Hello Team, I am trying to migrate few process group of my canvas to Another NiFi Server. I have created a template of that process group and trying to import it on another server. While doing so its saying following message: [cid:image001.png@01D98298.A7B61C30] I have also replaced the