Re: NiFi stops processing further flowfiles

2017-11-28 Thread Panos Geo
gh RestApi /nifi-api/flow/status Thanks, Juan On Fri, Nov 24, 2017 at 1:24 PM Panos Geo mailto:panospanos1...@outlook.com>> wrote: Thanks for your reply Juan. I have been using NiFi for almost 2 years now and didn't know about this setting. I 'll try to increase it and see

Re: NiFi stops processing further flowfiles

2017-11-26 Thread Panos Geo
erimental. Your thread count is shown on the UI or can be called through RestApi /nifi-api/flow/status Thanks, Juan On Fri, Nov 24, 2017 at 1:24 PM Panos Geo mailto:panospanos1...@outlook.com>> wrote: Thanks for your reply Juan. I have been using NiFi for almost 2 years now and didn

Re: NiFi stops processing further flowfiles

2017-11-26 Thread Panos Geo
ed through RestApi /nifi-api/flow/status Thanks, Juan On Fri, Nov 24, 2017 at 1:24 PM Panos Geo mailto:panospanos1...@outlook.com>> wrote: Thanks for your reply Juan. I have been using NiFi for almost 2 years now and didn't know about this setting. I 'll try to increase

Re: NiFi stops processing further flowfiles

2017-11-24 Thread Panos Geo
system can handle it increase the default "max thread" count found: Left side controller settings > Maximum timer driven thread count On Fri, Nov 24, 2017 at 10:47 AM Panos Geo mailto:panospanos1...@outlook.com>> wrote: Hello all, We are running NiFi in a docker container t

NiFi stops processing further flowfiles

2017-11-24 Thread Panos Geo
Hello all, We are running NiFi in a docker container that has roughly 500 processors running. These include consuming messages (MQTT), interaction with a database and some data processing with execute scripts. Our NiFi version is v.1.4.0 and this instance has 18GB of RAM with 12GB allocated to

Re: Migrating NiFi templates/canvas

2017-01-15 Thread Panos Geo
3173 On Fri, Jan 13, 2017 at 1:51 PM, Panos Geo mailto:panospanos1...@outlook.com>> wrote: Hello Matt, Thanks for your reply. I fully get that, but my requirement is in addition to this. The (top) controller service is being referenced by multiple processors in my template, which h

Re: Migrating NiFi templates/canvas

2017-01-13 Thread Panos Geo
e template. While this was initially by designed, we have received comments about it from folks looking to export their entire configuration. There is an outstanding JIRA [1] to update this behavior. Matt [1] https://issues.apache.org/jira/browse/NIFI-2895 On Fri, Jan 13, 2017 at 12:01 PM,

Re: Migrating NiFi templates/canvas

2017-01-13 Thread Panos Geo
thanks, Panos ____ From: Panos Geo Sent: Friday, January 13, 2017 4:47 PM To: users@nifi.apache.org Subject: Re: Migrating NiFi templates/canvas Hello Oleg, Many thanks for your reply! I remembered having diff'ed NiFi templates in the past and that was a bit messy. However, this was certa

Re: Migrating NiFi templates/canvas

2017-01-13 Thread Panos Geo
ates should be exported in a deterministic way so that they can be compared or diff'ed with another. Items to consider... The ordering of components The id's ... Anyway, give it a shot and let us know. Cheers Oleg On Jan 13, 2017, at 4:49 AM, Panos Geo mailto:panospanos1...

Migrating NiFi templates/canvas

2017-01-13 Thread Panos Geo
Hello all, We have a Continuous Integration/Continuous Development pipeline that involves for each stage (development, testing, customer deployment) a dedicated virtual machine running a NiFi instance. As such, for each stage of the pipeline we have to migrate the changes of our NiFi canvas fro

Re: Controller services visibility problem

2016-11-18 Thread Panos Geo
up and any child group. So if you want a Controller Service to be available to all Processors, you can simply create the Controller Service at the Root Process Group, and all child groups will then have access to it. Thanks -Mark On Nov 17, 2016, at 9:10 AM, Panos Geo mailto:panospanos1...@o

Controller services visibility problem

2016-11-17 Thread Panos Geo
Hello all, We are using NiFi 1.0 over http without any authentication, so all our users are coming to NiFi as anonymous. The problem we are having is of controller services visibility. So if we create a controller service (say database connection) from the top right option of the canvas, this

RE: AvroRuntimeException : Duplicate field name

2016-04-26 Thread Panos Geo
moment. I won't exclude also bug in NiFi. Thanks Toivo 2016-04-25 12:13 GMT+03:00 Panos Geo : Hello Toivo, all, I am not sure what else would you require from me to test this. In my view, this appears to be a bug as no matter what I've tried any SQL statement where fields from diff

RE: AvroRuntimeException : Duplicate field name

2016-04-25 Thread Panos Geo
L Junit test case must be created. Then we can investigate problem. Unfortunately I don't have other ideas (at least at the moment). thanks toivo 2016-04-21 19:26 GMT+03:00 Panos Geo : No worries, I appreciate your help anyhow. I am using MariaDB, but I get the below as warning when I star

RE: AvroRuntimeException : Duplicate field name

2016-04-21 Thread Panos Geo
03:00 Panos Geo : Hello Toivo, Many thanks for your reply! As I have indicated in my initial email, using aliases doesn't make any difference. It appears as if they are ignored and I am getting the same error. Any other thoughts? Many thanks,Panos Date: Thu, 21 Apr 2016 18:59:33 +0300 S

RE: AvroRuntimeException : Duplicate field name

2016-04-21 Thread Panos Geo
T plant.name as pname, area.area_id, area.name as aname thanks toivo 2016-04-21 18:51 GMT+03:00 Panos Geo : Hello all,I would appreciate your help in the Avro error that I am seeing. I am executing the following very simple SQL select statement using the ExecuteSQL processor : SELECT plan

AvroRuntimeException : Duplicate field name

2016-04-21 Thread Panos Geo
Hello all,I would appreciate your help in the Avro error that I am seeing. I am executing the following very simple SQL select statement using the ExecuteSQL processor : SELECT plant.name, area.area_id, area.nameFROM plant, area WHERE plant.plant_id=area.plant_id;…and I get the following erro