And thanks Joe for sanity checking the approach :)
On Wed, Dec 15, 2021 at 2:34 PM Bryan Rosander
wrote:
> Ah, glad that worked. I did mess up step 3 of usage, the only arg should
> be the path to a NiFi install:
>
> 3. Run 'java Log4jPatch /PATH/TO/NIFI'
>
> If any
Bryan
> >>
> >> This type of approach would work generally quite fine. Did you paste
> >> the link you intended or did you forget to link to the patch?
> >>
> >> Thanks
> >>
> >> On Wed, Dec 15, 2021 at 12:01 PM Bryan Rosander <
> b
d56f5
On Wed, Dec 15, 2021 at 2:06 PM Joe Witt wrote:
> Bryan
>
> This type of approach would work generally quite fine. Did you paste
> the link you intended or did you forget to link to the patch?
>
> Thanks
>
> On Wed, Dec 15, 2021 at 12:01 PM Bryan Rosander
> w
Hey all,
I wrote up a utility to patch all nars in a given NiFi install to
remove JndiLookup.class from log4j jars. It has no dependencies and the
single file can be compiled and run as-is.
It looks like it should be handled pretty well if the class is just missing
since they didn't expect it to
ry instances but the closest to that kafka class
is org.apache.hadoop.security.SaslPlainServer$SaslPlainServerFactory.
Thanks,
Bryan Rosander
On Wed, May 17, 2017 at 12:28 PM, Bryan Bende wrote:
> Hi Arnaud,
>
> I created a flow that had PublishKafka_0_10 running with dynamic JAAS
>
Hey Tim,
That's pretty strange that your breakpoints aren't being hit. In the past
when things like that have happened to me, it's usually due to me
successfully connecting but to the wrong JVM.
If you're trying to debug code related to the bootstrap process itself
(RunNiFi or anything it calls)
One way to see what the payload should look like would be to open up the
network tab in your browser and perform the action you're trying to
automate. You should be able to see what requests the NiFi UI performs and
replicate those.
Thanks,
Bryan
On Wed, Apr 19, 2017 at 11:49 AM, Joe Witt wrote
Hi Tom,
Glad to hear you're giving MiNiFi a spin!
1. The dump should be written out to the bootstrap log file.
2. nifi.properties is indeed regenerated from the yml on start. There is
an unreleased change [1] that allows for overriding of arbitrary properties
that should be in the next release
Hi Jennifer,
I would think that for a script of moderate or more complexity, having it
versioned (git, svn, etc) would be useful. Also, it should definitely not
be writable by users other than (and possibly including) NiFi as it could
be modified to do something malicious.
Thanks,
Bryan
On Tue,
p in any queue leading into or coming out
> of any processor.
>
> On Wed, Apr 5, 2017 at 2:44 PM, Bryan Rosander
> wrote:
>
>> It looks like HandleHttpRequest should be sending back a 503 if its
>> containerQueue fills up (default capacity of 50 requests that have been
&g
017 at 2:23 PM, James McMahon
> wrote:
> > Yes sir! Sure am. And I know, because I have committed that very silly
> > mistake before. We are indeed seeing # responses = # requests -Jim
> >
> > On Wed, Apr 5, 2017 at 2:13 PM, Bryan Rosander
> wrote:
> >>
>
Hey James,
Are you making sure that every route from HandleHttpRequest goes to
a HandleHttpResponse? If not, the StandardHttpContextMap may be filling up
with requests which would probably delay processing.
Thanks,
Bryan
On Wed, Apr 5, 2017 at 2:07 PM, James McMahon wrote:
> Thank you very mu
Another thing to consider is whether the bottleneck is in NiFi or before it
gets there. Is the source of data capable of making post requests more
quickly than that as configured? Is network latency or throughput a
limitation? You might try a another http server to see whether the problem
is with
e is processed by the ExecuteScript instance.
> Would the Controller Service establish those one-time loggers and one-time
> file handles for us, which I could then reference in my python scripts in
> Execute Script A and B?
>
> If this is what you envision, then it would be something
Hey James,
I wonder if you'd be better suited with a Controller Service that could
provide access to configured loggers, etc.
It looks like ExecuteScript can lookup Controller Services [1]. A
script-based Controller Service implementation (so you could use python or
another scripting language th
Hi Kumar,
I would suggest using NiFi's tls-toolkit in order to facilitate certificate
generation. It can generate a Certificate Authority (to import into the
browser), keystore and truststore for NiFi as well as a client p12 file in
a single command.
You can get it from the NiFi download page as
Hey Brian,
One good resource around the ExecuteScript processor is Matt Burgess' blog
[1]. Matt wrote the ExecuteScript processor and has a bunch of how-to
guides there.
[1] http://funnifi.blogspot.com/
Thanks,
Bryan
On Tue, Feb 21, 2017 at 2:51 PM, BD International <
b.deep.internatio...@gmail
Hey Arnaud,
Andy's solution is definitely the right answer for Java applications in
general (on docker or in vm or anywhere with more limited entropy).
A more general way to take care of entropy issues in docker containers
(applicable beyond NiFi) is to mount the host's /dev/random or /dev/urando
Hey Peter,
Weighing in at 200MB means it is likely a heap dump (all working memory).
A thread dump should be much smaller. If using jcmd, please try
Thread.print as the command. Another alternative would be to use jstack
[PID].
Thanks,
Bryan
On Fri, Jan 27, 2017 at 9:24 AM, Peter Wicks (pwicks
Yes, thank you very much, I did and I wasn't even thinking about that
> (port 8000 no less).
>
> Embarrassed,
>
> Russ
>
> On 11/04/2016 11:47 AM, Bryan Rosander wrote:
>
> Hey Russ,
>
> It looks like you may have configured NiFi for remote debugging. If yo
Hey Russ,
It looks like you may have configured NiFi for remote debugging. If you
have port conflicts on the port Java tries to listen on for remote
debugging, you'll see an error just like that.
Thanks,
Bryan
On Fri, Nov 4, 2016 at 1:46 PM, Russell Bateman <
russell.bate...@perfectsearchcorp.c
I'm not sure of the use case either but if there is one, it should be
pretty easy to let the user select the type of Map they'd prefer to store
it in.
HashMap should probably be default if order doesn't matter, LinkedHashMap
if you want to maintain insertion order, TreeMap if you want alphabetical
Hi Tom,
Please try the nifi-toolkit download at
https://nifi.apache.org/download.html
The encrypt-config tool is part of the nifi-toolkit. This is so that
things that are useful when configuring NiFi but are not necessarily needed
at runtime won't be bundled into every NiFi archive.
Thanks,
Bry
Hi Thomas,
Currently the tls-toolkit can be used in either standalone or client/server
mode. Standalone has a couple of ease-of-use advantages such as being able
to be run from a single location to generate keystores and truststores as
well as nifi.properties files for the whole NiFi cluster. If
Hey Michael,
Your best bet will probably be to use the site-to-site functionality of
NiFi in order to bridge the Kerberos (and potentially Hadoop distribution
version) gap. Configure one instance of NiFi to talk to each cluster and
have them exchange data over site-to-site.
These instances of Ni
Hi Huagen,
1. The ExecuteStreamCommand uses a ProcessBuilder under the covers. If you
want wildcard expansion, you should avoid quoting the arg to be expanded.
Alternatively, you could run bash as your command with -c as the first
argument and then the original command as a single argument to bas
command and the script name
for the first argument.
(http://stackoverflow.com/questions/18240944/cannot-launch-shell-script-with-arguments-using-java-processbuilder#answer-18241604)
If any of this info is bad, hopefully someone else will chime in. I’m still
new around here ☺
Thanks,
Bryan
27 matches
Mail list logo
