Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Otto Fowler
Well it is in review right now, and there will be changes up coming. On April 27, 2020 at 23:12:21, Luis Carmona (lcarm...@openpartner.cl) wrote: Hi Otto, Compiled your version, and It DID WORK !!. How risky is to use this "version" in a production environment ? Thanks a lot. LC On Mon,

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Luis Carmona
Hi Otto, Compiled your version, and It DID WORK !!. How risky is to use this "version" in a production environment ? Thanks a lot. LC On Mon, 2020-04-27 at 11:05 -0700, Otto Fowler wrote: > No, Luis, if the PR is accepted and lands, it will be in the next > released version of nifi after

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Andy LoPresto
ExecuteProcess and ExecuteStreamCommand both allow shell commands to be run; ExecuteProcess does not allow incoming flowfiles but ExecuteStreamCommand does. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Luis Carmona
Hi Wesley, couldn't use Execute Processor as it doesn't receive an input FlowFile ( or I didn't find out how to connect it ) and I need to give to the procesor the file that should be sent. Thanks anyway. Will try with a script now. LC On Mon, 2020-04-27 at 14:26 -0300, Wesley C. Dias de

Re: OIDC Redirect loop

2020-04-27 Thread Ami Goldenberg
Actually with a set of 1 this would not have mattered. I think the problem is not with the sticky sessions... On Mon, Apr 27, 2020 at 9:43 PM Ami Goldenberg wrote: > Great idea Andy > > I reduced the scale to 1 and it is still doing the same redirect loop. > I guess the load balancer is hitting

Re: OIDC Redirect loop

2020-04-27 Thread Ami Goldenberg
Great idea Andy I reduced the scale to 1 and it is still doing the same redirect loop. I guess the load balancer is hitting a different node even if sticky is set up? Even if eventually the service does clientAffinity maybe the client IP is not taken correctly? What are your thoughts? On Mon,

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Luis Carmona
OK Otto, got it. LC On Mon, 2020-04-27 at 11:05 -0700, Otto Fowler wrote: > No, Luis, if the PR is accepted and lands, it will be in the next > released version of nifi after that. > > If you build nifi yourself, it will be available when you build > master after it lands. > > On April

Re: OIDC Redirect loop

2020-04-27 Thread Wyllys Ingersoll
I have a very similar configuration and similar problem. After authenticating with the OIDC server (Keycloak), I often get multiple failures in verifying the JWT from the nifi servers and have to reload the browser multiple times until it eventually hits the right one. On Mon, Apr 27, 2020 at

Re: OIDC Redirect loop

2020-04-27 Thread Andy LoPresto
Can you verify the initial redirect to OIDC and the callback are going to the same node in NiFi? I see your LB configs are set to sticky sessions, but it may be that if the callback is originating from the OIDC IDP server rather than the actual client IP, the session affinity is not being

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Luis Carmona
Thank you all, Wesley and Etienne, is there any documentation source about how to connect a script in javascript to nifi resources, InputStream, OutputStream, Erros, and so on ? Otto, sure I can give it a try, I am desperate for this solution. What you mention means I have to look for a

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Otto Fowler
No, Luis, if the PR is accepted and lands, it will be in the next released version of nifi after that. If you build nifi yourself, it will be available when you build master after it lands. On April 27, 2020 at 13:56:36, Luis Carmona (lcarm...@openpartner.cl) wrote: Thank you all, Wesley and

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Wesley C. Dias de Oliveira
Owh! Great, Otto! Good news! Em seg., 27 de abr. de 2020 às 14:50, Otto Fowler escreveu: > What good timing, I just did : https://github.com/apache/nifi/pull/4234 > If you can build and try that would be sweet! or maybe a review! > > On April 27, 2020 at 13:45:42, Etienne Jouvin

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Otto Fowler
What good timing, I just did : https://github.com/apache/nifi/pull/4234 If you can build and try that would be sweet! or maybe a review! On April 27, 2020 at 13:45:42, Etienne Jouvin (lapinoujou...@gmail.com) wrote: Hello. I did it with a processor ExecuteGroovyScript. The script body is

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Luis Carmona
Hi Wesley, no, haven't used any processor related to do things out of NIFI itself. Will give it a try thanks. LC On Mon, 2020-04-27 at 14:26 -0300, Wesley C. Dias de Oliveira wrote: > Hello, Luis. > > Have you tried to send with ExecuteProcessor? > > > > Using that way you can invoke

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Etienne Jouvin
Hello. I did it with a processor ExecuteGroovyScript. The script body is something like : import org.apache.http.entity.mime.MultipartEntityBuilder import org.apache.http.entity.ContentType flowFileList = session.get(100) if(!flowFileList.isEmpty()) { flowFileList.each { flowFile -> def

POST multipart/form-data with Invokehttp

2020-04-27 Thread Luis Carmona
Hi everyone, Hoping everybody is doing ok, wherever you are, need some help please. Does anyone has sent a file and parameters to a REST point using Invokehhtp with multipart/form-data as mime-type ? I can't figure out how to include the -F , speaking in terms of curl syntax. I really need

Re: POST multipart/form-data with Invokehttp

2020-04-27 Thread Wesley C. Dias de Oliveira
Hello, Luis. Have you tried to send with ExecuteProcessor? [image: image.png] Using that way you can invoke curl explicit to run your command. Em seg., 27 de abr. de 2020 às 14:21, Luis Carmona escreveu: > Hi everyone, > > Hoping everybody is doing ok, wherever you are, need some help

Re: OIDC Redirect loop

2020-04-27 Thread Ami Goldenberg
Hi Nathan, Indeed, that's the case On Mon, Apr 27, 2020 at 5:57 PM Nathan Gough wrote: > Hi Ami, > > Just to confirm, the OAuth Client ID redirect URL in OIDC is set to " > https://${nifi.hostname}:${nifi.port}/nifi-api/access/oidc/callback; and > the NiFi property is set

Re: OIDC Redirect loop

2020-04-27 Thread Nathan Gough
Hi Ami, Just to confirm, the OAuth Client ID redirect URL in OIDC is set to " https://${nifi.hostname}:${nifi.port}/nifi-api/access/oidc/callback; and the NiFi property is set "nifi.security.user.oidc.discovery.url= https://accounts.google.com/.well-known/openid-configuration;. Nathan On Mon,

Re: MergeRecord performance

2020-04-27 Thread Mark Payne
Robert, What kind of performance degradation were you seeing here? I put together some simple flows to see if I could reproduce using 1.9.2 and current master. My flow consisted of GenerateFlowFile (generating 2 CSV rows per FlowFile) -> ConvertRecord (to Avro) -> MergeRecord (read Avro, write

Re: OIDC Redirect loop

2020-04-27 Thread Edward Armes
Hi Ami, Biased on the error you've got in the user log it looks like you've got a local trust issue. If you could tell us what you've already tried, someone might be able to help you a bit more. Edward On 27/04/2020 05:36, Ami Goldenberg wrote: Hi, We are trying to deploy NiFi on