Re: CryptographicHashContent calculates 2 differents sha256 hashes on the same content

2021-10-20 Thread Joe Witt
Jens, Also what type of file system/storage system are you running NiFi on in this case? We'll need to know this for the NiFi content/flowfile/provenance repositories? Is it NFS? Thanks On Wed, Oct 20, 2021 at 11:14 AM Joe Witt wrote: > > Jens, > > And to further narrow this down > > "I have

Re: CryptographicHashContent calculates 2 differents sha256 hashes on the same content

2021-10-20 Thread Joe Witt
Jens, And to further narrow this down "I have a test flow, where a GenerateFlowfile has created 6x 1GB files (2 files per node) and next process was a hashcontent before it run into a test loop. Where files are uploaded via PutSFTP to a test server, and downloaded again and recalculated the

Re: CryptographicHashContent calculates 2 differents sha256 hashes on the same content

2021-10-20 Thread Joe Witt
Jens, "After fetching a FlowFile-stream file and unpacked it back into NiFi I calculate a sha256. 1 minutes later I recalculate the sha256 on the exact same file. And got a new hash. That is what worry’s me. The fact that the same file can be recalculated and produce two different hashes, is very

Re: CryptographicHashContent calculates 2 differents sha256 hashes on the same content

2021-10-20 Thread Jens M. Kofoed
Dear Mark and Joe I know my setup isn’t normal for many people. But if we only looks at my receive side, which the last mails is about. Every thing is happening at the same NIFI instance. It is the same 3 node NIFI cluster. After fetching a FlowFile-stream file and unpacked it back into NiFi I

Re: Nifi and Registry behind Citrix ADC.

2021-10-20 Thread Bryan Bende
Yes, you can think of it the same as how NiFi -> NiFi Registry works... User accesses NiFi and authenticates in some way, could be client cert, they then perform an action that calls registry. NiFi makes a 2-way TLS connection to registry using it's own server cert and sends the end user identity

Re: CryptographicHashContent calculates 2 differents sha256 hashes on the same content

2021-10-20 Thread Mark Payne
Jens, Thanks for sharing the images. I tried to setup a test to reproduce the issue. I’ve had it running for quite some time. Running through millions of iterations. I’ve used 5 KB files, 50 KB files, 50 MB files, and larger (to the tune of hundreds of MB). I’ve been unable to reproduce an

RE: Nifi and Registry behind Citrix ADC.

2021-10-20 Thread Shawn Weeks
I didn't know that was supported. Does this require the Proxy to do 2-way ssl back to NiFi? Thanks Shawn -Original Message- From: Bryan Bende Sent: Wednesday, October 20, 2021 9:02 AM To: users@nifi.apache.org Subject: Re: Nifi and Registry behind Citrix ADC. If the load balancer can

Re: Nifi and Registry behind Citrix ADC.

2021-10-20 Thread Bryan Bende
If the load balancer can pass the client cert DN in the X-ProxiedEntitiesChain header, then it doesn't have to be a straight pass through. The load balancer identity would need to be authorized as a proxy in NiFi or NiFi Registry.