Re: Nifi Debugging AWS PutS3 processor

2016-09-12 Thread James Wing
You might try capturing flow logs for your VPC. It can be a bit tedious, but it might confirm which connections to S3 are successful and which are blocked by your network configuration, if any. I must admit to being puzzled by the intermittent nature of the problem. https://docs.aws.amazon.com/A

Re: Conceptual flow view.

2016-09-12 Thread Toivo Adams
Hi Joe, I used WebCrawler.xml template as example https://cwiki.apache.org/confluence/display/NIFI/Example+Dataflow+Templates First as it is And conceptual view.

Re: Nifi Debugging AWS PutS3 processor

2016-09-12 Thread Joe Skora
Julie, If some traffic gets through and some times out, it sounds like a network problem. I would check the system memory/load and network load, either can cause network response and timeout problems. JoeS On Mon, Sep 12, 2016 at 8:44 AM, jmurakami wrote: > Good morning, > > After changing th

Re: Conceptual flow view.

2016-09-12 Thread Joe Witt
Toivo There are certainly a lot of opportunities to keep driving richer and richer user experience. Could you share maybe a concept diagram or a more detailed writeup? Would definitely like to dive further into this idea. Thanks Joe On Mon, Sep 12, 2016 at 7:44 AM, Toivo Adams wrote: > Hi, >

Re: Nifi Debugging AWS PutS3 processor

2016-09-12 Thread jmurakami
Good morning, After changing the endpoint override property, I still have some requests of the PutS3 processor failing with the same error Connection Timed Out. The errors are coming from all three of the instances running Nifi in our cluster. I was also wondering what the Communications Timeout

Conceptual flow view.

2016-09-12 Thread Toivo Adams
Hi, NiFi has one view for the designing flow and runtime. I wonder is it possible to have separate design time view? Which show simplified conceptual view. Conceptual view is without runtime metric (In, Read/Write bytes, etc). Such view has better readability and can be used to represent ideas to

Re: Anyone having issues running nifi-kafka-0-9-processors junits?

2016-09-12 Thread Oleg Zhurakousky
Ok, I’ll take a look at it. > On Sep 12, 2016, at 9:20 AM, Joe Skora wrote: > > I've been seeing it for a week for sure, not sure about previously. > > But it is intermittent, a re-run usually succeeds. > > On Mon, Sep 12, 2016 at 8:58 AM, Andre wrote: > >> Oleg, >> >> Yes, it is intermitte

Re: Anyone having issues running nifi-kafka-0-9-processors junits?

2016-09-12 Thread Joe Skora
I've been seeing it for a week for sure, not sure about previously. But it is intermittent, a re-run usually succeeds. On Mon, Sep 12, 2016 at 8:58 AM, Andre wrote: > Oleg, > > Yes, it is intermittent and it only seen it happening when using -T > > I would say it happens 1 out of 5 times so we

Re: Anyone having issues running nifi-kafka-0-9-processors junits?

2016-09-12 Thread Andre
Oleg, Yes, it is intermittent and it only seen it happening when using -T I would say it happens 1 out of 5 times so we can say it is intermittent. If I recall correctly, Kafka 0.9 is the most common failure but give me a few days and I will try to confirm that. Cheers On Mon, Sep 12, 2016 at