Re: ExecuteScript Concurrent Tasks

2020-12-13 Thread Mike Thomsen
The concurrency setting doesn't give extra threads to the jython engine, if
that's what you mean. It sets the maximum threads that can run
ExecuteScript simultaneously. So all you'd get is two single threaded
scripts running if you bump it to two threads.

As to the groovy issue, absolutely. Groovy is night and day more performant
and supported than jython. The only python code my team uses with nifi is
edge cases where what we need can only be scripted in a few lines with
python 3 and it's worth the overhead of calling that with execute stream
command.

On Thu, Dec 10, 2020, 11:53 Noe Detore  wrote:

> Hello,
>
> Concurrent tasks increased using ExecuteScript or InvokeScriptedProcessor
> with python/jyphon to update content has no increased throughput. If I copy
> the processor and run the 2 in parallel the amount of data processed does
> not increase. Any explanation for this? Is there a system-wide setting for
> how much cpu is available to the Jython engine?
>
> Would refactoring into groovy improve throughput or is it best to create a
> custom processor?
>
> thank you
> Noe
>


ExecuteScript Concurrent Tasks

2020-12-10 Thread Noe Detore
Hello,

Concurrent tasks increased using ExecuteScript or InvokeScriptedProcessor
with python/jyphon to update content has no increased throughput. If I copy
the processor and run the 2 in parallel the amount of data processed does
not increase. Any explanation for this? Is there a system-wide setting for
how much cpu is available to the Jython engine?

Would refactoring into groovy improve throughput or is it best to create a
custom processor?

thank you
Noe