Re: Flow.xml.gz gets overwritten with Empty Flow.xml

2020-08-21 Thread jgunvaldson
Just FYI, I found the answer https://community.cloudera.com/t5/Support-Questions/NiFi-Toolkit-Can-t-start-NiFi-with-a-75MB-gzipped-flow-xml/td-p/288712 Exact same problem with proper solution Fixed… > On Aug 21, 2020, at 3:48 PM, jgunvaldson wrote: > > We have a production instance of NIFI (

Re[2]: access property in ScriptedRecordSetWriter?

2020-08-21 Thread David Early
Matt, The method "initialization" in AbstractControllerService is this: @Override public final void initialize(final ControllerServiceInitializationContext context) throws InitializationException { this.identifier = context.getIdentifier(); serviceLookup = context.getControllerServiceLookup();

Flow.xml.gz gets overwritten with Empty Flow.xml

2020-08-21 Thread jgunvaldson
We have a production instance of NIFI (1.9.0.3.4.1.1-4 built 05/01/2019 02:15:30 UTC Tagged nifi-1.9.0-RC2) with an unusual symptom. We know, that on a new instance of NIFI, the canvas comes up empty (result of a new flow.xml). Developers then start building process groups and more from this sta

Re: access property in ScriptedRecordSetWriter?

2020-08-21 Thread Matt Burgess
Oops copy paste error, the GroovyScriptedRecordSetWriterFactory has to extend AbstractControllerService Sent from my iPhone > On Aug 21, 2020, at 4:50 PM, David Early wrote: > >  > Matt, > > This is very cool of you, and I feel like this is close, but once again > hanging up on my inexperie

Re[2]: access property in ScriptedRecordSetWriter?

2020-08-21 Thread David Early
Matt, This is very cool of you, and I feel like this is close, but once again hanging up on my inexperience with the Java environment for getting the pipes all lined up. Below is my entire code. Note you originally had : @Override def init(context) { mapCacheClient =

Re: access property in ScriptedRecordSetWriter?

2020-08-21 Thread Matt Burgess
Dave, Your snippet is looking good on the inside, but as you want a ScriptedRecordSetWriter you will want to create that instead of a Processor, something like this: class GroovyRecordSetWriter implements RecordSetWriter { private int recordCount = 0 private final OutputStream out pri

Re: access property in ScriptedRecordSetWriter?

2020-08-21 Thread davide
Matt, Thanks for the reply. And this is where I admit to being relatively new to Java environments (having done mostly Python and C++ if you go back far enough). So I understand if you don't have the cycles to give me too much of a foundational lesson, but here is where I am stuck: You said tha

Wait and Notify is very slow

2020-08-21 Thread KhajaAsmath Mohammed
Hi, I have seen an issue where wait and notify processor performance is very slow when the number of files is greater than 1000. It runs faster if it is less than 1000. Is there a way setting on map cache client service that can speed up ? [image: image.png] Thanks, Asmath

Re: access property in ScriptedRecordSetWriter?

2020-08-21 Thread Matt Burgess
Dave, For ScriptedRecordSetWriter (and all the scripted Controller Services), you provide the properties yourself, rather than (like ExecuteScript) defining dynamic properties and referring to them from the script. I have an example [1] of using Record controller services from InvokeScriptedProces

access property in ScriptedRecordSetWriter?

2020-08-21 Thread davide
All, I am new to the scripted record environment but have done Groovy scripts with ExecuteScript and other customizations with the interface... So not a power user but maybe mid-tier. I am trying to create a ScriptedRecordSetWriter that accesses a controller service (map cache). We need to do a