Re: The mystery of ListSFTP that stops working

2017-11-17 Thread kapkbr
After some more debugging, I have observed that Nifi is messing ZK nodes after many stops and starts. I have pointed Nifi to newly created path in ZK (zookeeper) and everything started working. -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: The mystery of ListSFTP that stops working

2017-11-17 Thread kapkbr
I am seeing similar problem, It shows both Tasks/Duration as 0 (Sreenshot 1). It shows the status as started, but appear never spawned task. Configuration of the task is Timer driven Run Schedule 0 Primary node only Yield 1 sec penalty 30 sec I have tried to change yield and other things, but no

Re: Custom properties file for environmental promotion

2017-11-17 Thread wildo
Thanks Bryan. I just wrapped this up and wanted to document for anyone in the future. -Yes, updating the kerberos principal/keytab values via the xml template worked just fine. -Yes, updating the target url fields on the RPG worked just fine. -Yes, Bryan was absolutely correct that you DO need to

NiFi 1.3 - PublishKafka_0_10 - A message in the stream exceeds the maximum allowed message size of 1048576 bytes

2017-11-17 Thread mayank rathi
Hello All, I am getting this error in PublishKafka_0_10 processor for a message of size 2.08 MB. I have updated Max Request Size to 10 MB in processor properties and max.request.size to 10 MB in Kafka's server.properties. After reboot Kafka Broker I can see that max.request.size = 10 MB in Kafka l

RE: [EXT] Re: Automated Testing of Flows

2017-11-17 Thread Chris Herrera
Hi Peter, One thing I have had success with in the past is very similar to what you are stating here. Basically a test framework built in python that is just applying the flow to a processor group for a test, and then performing the tests. NiFi it self is stood up inside of a docker container t