Re: Duplicate Attribute Values in Extract Text Processor Output

2020-06-26 Thread muhyid72
Hi Mark, Thanks for your answer Actually i don't have so much experience on NiFi I guess, i couldn't understand correctly your explanation I want to append extra words beginning of each line for example: my IIS Log File line like this: 2020-03-13 13:59:19 XXX-YYY GET /Maintenance/Status.svc

Zookeeper ACL question

2020-06-26 Thread dan young
Hello, I was looking at setting up zookeeper with basic password ACL in a small cluster. Looking at the Nifi docs it mentions something about Username/Password,vs using Kerberos, in the Zookeeper Access Control under the state providers.

Re: Duplicate Attribute Values in Extract Text Processor Output

2020-06-26 Thread Mark Payne
You’ll want to connect FetchAzureBlob -> ReplaceText -> PutTCP. ReplaceText would use the Evaluation Mode of Line-by-Line to update the text. Or, alternatively, you could use UpdateRecord. Thanks -Mark > On Jun 26, 2020, at 2:36 PM, muhyid72 wrote: > > Hi Mark, > > Thank you so much for

Re: Duplicate Attribute Values in Extract Text Processor Output

2020-06-26 Thread muhyid72
Hi Mark, Thank you so much for valuable advice. I tried PutTCP it seems working. I would like to make a summary for your explanation and ask a questions If I understand correctly; 1. Getting IIS Log Files from Azure Blob Storage same as before 1.1. List Azure Blob Storage Processor 1.2. Route

Re: Messed with PutS3Object, add signature on top on content

2020-06-26 Thread Pierre Villard
Glad you figured it out and thanks for sharing your findings with the community! Le ven. 26 juin 2020 à 16:49, Etienne Jouvin a écrit : > Hello all. > > Got it. > It was a matter of signature version. > Because I use s3Ninja, I needed to set with V2 : > [image: image.png] > > > > > > Le ven. 26

Re: Replacing a base64-encoded field in a JSON-document with its decoded/converted value

2020-06-26 Thread Pierre Villard
Hi, I think that would be a perfect use case for NIFI-7572 [1] once there is a solution for it. [1] https://issues.apache.org/jira/browse/NIFI-7572 Le ven. 26 juin 2020 à 08:20, Myklebust, Bjørn Magnar < bjorn.mykleb...@skatteetaten.no> a écrit : > Ok, I see. > > Thanks, Andy. > > > > Bjørn >

Re: Messed with PutS3Object, add signature on top on content

2020-06-26 Thread Etienne Jouvin
Hello all. Got it. It was a matter of signature version. Because I use s3Ninja, I needed to set with V2 : [image: image.png] Le ven. 26 juin 2020 à 15:43, Etienne Jouvin a écrit : > Hello all. > > I am trying to use S3 storage (s3Ninja for "unit test") and I am really > messed about how it

Messed with PutS3Object, add signature on top on content

2020-06-26 Thread Etienne Jouvin
Hello all. I am trying to use S3 storage (s3Ninja for "unit test") and I am really messed about how it works. Simple process [image: image.png] I fetch a simple PDF content and try to post to s3. But in the resulting content, I found the first line :

Re: Duplicate Attribute Values in Extract Text Processor Output

2020-06-26 Thread Mark Payne
If performance is the problem, then you definitely want to get rid of any SplitText / Split* processors. These processors are great when they are necessary but they should be avoided if at all possible, because splitting the data apart results in huge overhead for NiFi and will harm performance

Re: Custom service in NAR generation failure

2020-06-26 Thread Juan Pablo Gardella
I will try to reproduce it (I have a project where I can reproduce the problem) and then fill a JIRA. I hope I can reproduce it again :) Juan On Fri, 26 Jun 2020 at 09:19, Etienne Jouvin wrote: > Some update. > > I wanted to reproduce the error in a fresh new project. But no way to have > it

Re: Custom service in NAR generation failure

2020-06-26 Thread Etienne Jouvin
Some update. I wanted to reproduce the error in a fresh new project. But no way to have it again. So for the moment, I am not able to show an example. I will give it a try later. Sorry about that Le ven. 19 juin 2020 à 15:48, Bryan Bende a écrit : > I haven't fully evaluated the fix, at a

SV: Replacing a base64-encoded field in a JSON-document with its decoded/converted value

2020-06-26 Thread Myklebust , Bjørn Magnar
Ok, I see. Thanks, Andy. Bjørn Fra: Andy LoPresto Sendt: torsdag 25. juni 2020 19:20 Til: users@nifi.apache.org Emne: Re: Replacing a base64-encoded field in a JSON-document with its decoded/converted value Hi Bjørn, No, XML to JSON conversion is not an Expression Language feature. You’ll

Re: Duplicate Attribute Values in Extract Text Processor Output

2020-06-26 Thread muhyid72
Hi Andy, Thank you for your great support My aim is transferring all IIS logs to syslog line by line. Therefore i am using split text for parsing line. I tried Route Text yesterday but i didn't accomplish to transfer line by line to syslog. Extract Text is transferring splitted line on the