Re: Looking for Help! Custom Processor NAR autoloader

Very important to distinguish here... You cannot hot reload the same nar (same component version info in the manifest). However, you can hot load additional new versions and select them in the UI. If you're tossing a new copy of the nar with the same manifest metadata in the lib it wont see it u

Re: Looking for Help! Custom Processor NAR autoloader

I confirmed previously that autoload applies to an initial load and won't hot-reload on NAR update (instead requires an instance restart). If the custom component doesn't come up, I'm pretty sure there was a problem with dependency resolution. Check the startup logs for errors and any WARN message

Looking for Help! Custom Processor NAR autoloader

Hello! I am looking for guidance on an issue I am facing concerning utilizing the autoloading of custom processors using the extensions directory. The issue is with autoloading custom processor NARs and being able to see them in the UI without a restart of the docker container. I can confirm t

Re: PutParquet generating invalid files - Can not read value at 0 in block -1 in file - Encoding DELTA_BINARY_PACKED is only supported for type INT32

Hi all, I opened a Jira: https://issues.apache.org/jira/browse/NIFI-7495 Regards, Henrique Em 15/05/2020 16:49, Henrique Nascimento escreveu: I´m having some trouble in a production environment with PutParquet processor. When my flow file has only header + 1-3 records, the PutParquet suc

RE: Accessing flow attributes from ExecuteStreamCommand

Thanks Mike That was my fallback in case it was not supported out of the box. I guess another alternative would be to create a custom processor or use some other engine/cache such as Redis to store the data if it becomes too large. Thanks Sent from Mail

Re: Accessing flow attributes from ExecuteStreamCommand

I think Mike is referring to the “command arguments” & “command arguments strategy” processor properties when he says “parameters”, as this is different from NiFi parameters. If the Python script can run in Jython (2.x only, no native libs), you could put the script into an ExecuteScript or In

Best way to handle XMLTYPE in SQL processors

We have a really weird query we have to run that generates a XML document as the result. What is the best way/is it possible to run that query and convert the output to a string so that we're not fighting with the Avro API? Thanks, Mike

Re: Need help converting xml data

Hi Jens, Unfortunately, this looks like a bug in the schema inference for XML. The schema inference appears to be inferring a type of String for the Details, but the XML Reader is actually returning a Record. As a result, it turns that record into a String, which gives you the odd output like

Re: Accessing flow attributes from ExecuteStreamCommand

There's not way at the moment to interact with the NiFi API from that processor. The closest work around would be to pass in flowfile attributes as parameters using the parameter configuration field and expression language. On Thu, May 28, 2020 at 10:28 AM Jean-Sebastien Vachon < jsvac...@brizodat

Accessing flow attributes from ExecuteStreamCommand

Hi all, I am using the ExecuteStreamCommand processor to run a python script to crunch different data and I was curious to know if such a processor could both read and/or write from/to the flow attributes. Can someone point me to the documentation if this is possible? I could not find it by my