Re: Possible Regression in PutAzureBlobStorage 1.12.0

2020-09-16 Thread Eric Secules
Hello, I noticed I maybe was not configuring the processor correctly but nothing went wrong until now. I had the following configured: *Container Name*: "base_container/A/B" *Blob*: ${filename} I changed it to this and it works: *Container Name*: "base_container" *Blob*: "/A/B/"${filename} Than

Re: Possible Regression in PutAzureBlobStorage 1.12.0

2020-09-16 Thread Paul Kelly
Hi Eric, We also noticed an issue with PutAzureBlobStorage when upgrading to NiFi 1.12.0, and I believe it has to do with changes made for https://issues.apache.org/jira/browse/NIFI-6913, where the default behavior changed to check to see if a container exists before writing a file, and creating t

Re: Possible Regression in PutAzureBlobStorage 1.12.0

2020-09-16 Thread Joey Frazee
Eric, can you share any details about your config (e.g., what do you have in the Blob property)? I tried the following scenarios in an upgrade to 1.12.0 and main and they seem to work. Pre-existing object: A/B/test.json New object: A/B/${filename}.json New object with new pseudo-dirs: ${rando

Re: Possible Regression in PutAzureBlobStorage 1.12.0

2020-09-16 Thread Eric Secules
Hello everyone, I was able to see why this is an issue. It's an issue that the blob is stored several layers deep at "my-container/A/B/my_test_blob.json" -Eric On Wed, Sep 16, 2020 at 10:49 AM Eric Secules wrote: > Hello everyone, > > I tried upgrading to 1.12.0 and right away noticed that > P

Possible Regression in PutAzureBlobStorage 1.12.0

2020-09-16 Thread Eric Secules
Hello everyone, I tried upgrading to 1.12.0 and right away noticed that PutAzureBlobStorage is failing due to the following error. I don't think it's an issue with access because I can use a ListAzureBlobStorage on the same container and I haven't changed the permissions of the container. And I di

Re: Securing NiFI behind a proxy (NGINX).

2020-09-16 Thread Kevin Doran
Hi, Your understanding is correct: In order to get the connections you want, NGINX will have to be recognized by NiFi as an authorized proxy. The client certificate DN will be used for each request, provided NGINX terminates that TLS connection from the client and passes the DN of the certifica

Re: Performance of DistributeLoad - Batch Size

2020-09-16 Thread Mark Payne
I wasn’t expecting a bug report either :) Re the record stuff: I agree that the schema handling can be a bit complicated when you’re getting started. Especially if you’re not familiar with Avro and the schema format that it uses. But typically once you create a couple of schemas and configure a