Re: Nifi - InvokeHTTP - retrying on 3xx with Location header issue

2015-11-08 Thread M Singh
Hi Joe: You are right - setting follow-redirects did not work and I did mix retry with redirect. I will wait for your enhancements. Thanks again for your help. On Sunday, November 8, 2015 8:31 PM, Joe Percivall wrote: Hello, Firstly, I think you're mixing up "retry" and "redirect

Re: Nifi - InvokeHTTP - retrying on 3xx with Location header issue

2015-11-08 Thread Joe Percivall
Hello, Firstly, I think you're mixing up "retry" and "redirect". The 3xx status code is for redirecting to another url and 5xx is to try again. The property we have is "Follow Redirects". Retrying doesn't involve a location header but the redirect does. That being said, I did a bit of digging

Re: Nifi - InvokeHTTP - retrying on 3xx with Location header issue

2015-11-08 Thread Joe Witt
Joe P, Do you have any other recommendations light of the work you're doing now to Invoke HTTP? Thanks Joe On Sun, Nov 8, 2015 at 9:49 PM, M Singh wrote: > Thanks Joe. > > When I look at the provenance of the flow file, it shows the status as 301 > as shown below but no Location attribute. > >

Re: Nifi - InvokeHTTP - retrying on 3xx with Location header issue

2015-11-08 Thread M Singh
Thanks Joe. When I look at the provenance of the flow file, it shows the status as 301 as shown below but no Location attribute. If I curl the url and check the headers it does show the Location attribute. invokehttp.status.code  301 On Sunday, November 8, 2015 4:58 PM, Joe Witt wrote:

Re: A "proxy" question from the irc channel

2015-11-08 Thread Joey Echeverria
I'm a big fan of Slack. We use it for all our internal communication at my company. I think that Slack overlaps a lot with the goals of IRC but that they'll attract different audiences. For better or worse, IRC is not the most approachable technology for many new users. I suspect that if we used bo

Re: Nifi - InvokeHTTP - retrying on 3xx with Location header issue

2015-11-08 Thread Joe Witt
Hello You can use provenance or a LogAttributes processor to see what the headers are of the flow file after InvokeHTTP executes. You may find the location header present as one of the attributes. If so then you should be able to use that attribute to establish the URL it will hit next time. Do

Nifi - InvokeHTTP - retrying on 3xx with Location header issue

2015-11-08 Thread M Singh
Hi: I am trying to use InvokeHTTP and have set the follow-retry to true, and have associated a self referencing relation for the InvokeHttp for no-retry (1xx, 2xx, and 3xx) and retry (5xx) relations.  But it looks like it retires only status 500 codes requests and for 3xx does not pick up the Lo

Re: A "proxy" question from the irc channel

2015-11-08 Thread Matt Burgess
True that. I'm an IRC fan too, just sharing other options :) Sent from my iPhone > On Nov 8, 2015, at 5:12 PM, Tony Kurc wrote: > > there is a set of people that will always associate irc with open source > software development projects. I don't mind lurking and redirecting people. > >> On Su

Re: A "proxy" question from the irc channel

2015-11-08 Thread Tony Kurc
there is a set of people that will always associate irc with open source software development projects. I don't mind lurking and redirecting people. On Sun, Nov 8, 2015 at 12:53 PM, Matt Burgess wrote: > Would we have more participation with something like a Slack team? Apache > Drill has one wi

Re: Nifi - Invoke Http (GetHttp) in a loop until a condition is true

2015-11-08 Thread Juan Jose Escobar
Hello, Connect the success relationship of the query part to update attribute and use the expression language to keep counter so that you can control how long to poll for. The expression can be something like "${retry.counter:replaceNull('0'):plus(1)}" (on retry.counter attribute). Then use RouteO

Nifi - Invoke Http (GetHttp) in a loop until a condition is true

2015-11-08 Thread M Singh
Hi: I am working on a data flow that involves repeated polling a http endpoint and based on a status flag in the response, fetch the results or poll the endpoint again. So, the flow is  - Submit a query - Check the results of the query at a status endpoint returned from the query submis

Re: A "proxy" question from the irc channel

2015-11-08 Thread Matt Burgess
Would we have more participation with something like a Slack team? Apache Drill has one with #user and #dev channels, seems to work pretty well and has various integrations with other tools (email, GitHub, Jira, etc.) Sent from my iPhone > On Nov 8, 2015, at 12:41 PM, Tony Kurc wrote: > > The

Re: A "proxy" question from the irc channel

2015-11-08 Thread Tony Kurc
The irc channel tends to me be or Josh Elser redirecting people to the mailing lists for memorialization. On Sun, Nov 8, 2015 at 12:35 PM, Joe Witt wrote: > Aldrin - regarding IRC [1] > > We definitely need to get this info up on the website. > > [1] > http://mail-archives.apache.org/mod_mbox/ni

Re: A "proxy" question from the irc channel

2015-11-08 Thread Joe Witt
Aldrin - regarding IRC [1] We definitely need to get this info up on the website. [1] http://mail-archives.apache.org/mod_mbox/nifi-dev/201411.mbox/%3CCA%2BLyY57QFsxDxrHoNX7PGHd%2BFvX3ymQ%3DM8OtDnYxNeZEg3pAsA%40mail.gmail.com%3E Thanks Joe On Sun, Nov 8, 2015 at 12:31 PM, Aldrin Piri wrote: >

Re: A "proxy" question from the irc channel

2015-11-08 Thread Aldrin Piri
Mild tangent. I vaguely remember it coming up on the mailing list quite some time ago, but is the IRC channel's information available anywhere on the site? Wasn't able to find anything immediately obvious. On Sun, Nov 8, 2015 at 12:19 PM, Tony Kurc wrote: > and a proxy from irc answer: > > An

Re: A "proxy" question from the irc channel

2015-11-08 Thread Tony Kurc
and a proxy from irc answer: Anyway, I did search the mail lists and figured out how to get things working. In order to help anyone else out how might now know, here's a useful way to google the mail lists: https://www.google.com/webhp?q=site:http:%2F%2Fmail-archives.apa

A "proxy" question from the irc channel

2015-11-08 Thread Tony Kurc
" I'd appreciate it if someone could tell me how to easily change a flow with JSON lines like {JSON} to {"x"={JSON}} . The ReplaceText processor seems like the right thing, but when I add almost anything to the ReplacementValue field to change the output, it causes problems and doesn't include th