Re: Merge Content De-fragment Max Bins
Cool. Thanks for both On Tue, Sep 27, 2022 at 6:23 PM Eric Secules wrote: > Hi Joe, > > It is done. https://issues.apache.org/jira/browse/NIFI-10553 I have a > unit test that I added on my fork and it is failing as expected. > > -Eric > > On Tue, Sep 27, 2022 at 5:35 PM Joe Witt wrote: > >> Eric >> >> Yeah I think I agree. Can you file a JIRA? >> >> >> Thanks >> >> On Tue, Sep 27, 2022 at 4:55 PM Eric Secules wrote: >> >>> Hello, >>> >>> I am using MergeContent in defragment mode. I am having a problem when >>> bins complete too early because they were evicted due to reaching the max >>> bin count. However, this behaviour doesn't make sense for defragment mode. >>> What I expect it would do is penalize and requeue flowfiles that didn't fit >>> in one of the existing bins if we're currently at the max bin capacity. >>> >>> Thanks, >>> Eric >>> >>
Re: Merge Content De-fragment Max Bins
Hi Joe, It is done. https://issues.apache.org/jira/browse/NIFI-10553 I have a unit test that I added on my fork and it is failing as expected. -Eric On Tue, Sep 27, 2022 at 5:35 PM Joe Witt wrote: > Eric > > Yeah I think I agree. Can you file a JIRA? > > > Thanks > > On Tue, Sep 27, 2022 at 4:55 PM Eric Secules wrote: > >> Hello, >> >> I am using MergeContent in defragment mode. I am having a problem when >> bins complete too early because they were evicted due to reaching the max >> bin count. However, this behaviour doesn't make sense for defragment mode. >> What I expect it would do is penalize and requeue flowfiles that didn't fit >> in one of the existing bins if we're currently at the max bin capacity. >> >> Thanks, >> Eric >> >
Re: Merge Content De-fragment Max Bins
Eric Yeah I think I agree. Can you file a JIRA? Thanks On Tue, Sep 27, 2022 at 4:55 PM Eric Secules wrote: > Hello, > > I am using MergeContent in defragment mode. I am having a problem when > bins complete too early because they were evicted due to reaching the max > bin count. However, this behaviour doesn't make sense for defragment mode. > What I expect it would do is penalize and requeue flowfiles that didn't fit > in one of the existing bins if we're currently at the max bin capacity. > > Thanks, > Eric >
Merge Content De-fragment Max Bins
Hello, I am using MergeContent in defragment mode. I am having a problem when bins complete too early because they were evicted due to reaching the max bin count. However, this behaviour doesn't make sense for defragment mode. What I expect it would do is penalize and requeue flowfiles that didn't fit in one of the existing bins if we're currently at the max bin capacity. Thanks, Eric
Trouble configuring logging
I am attempting to configure logging for NiFi. I have NiFi running in a Docker
container, which sends all console logs to AWS CloudWatch. Therefore, I am
configuring NiFi to send all logs to the console.
The problem is, for some reason all log messages are coming from the
org.apache.nifi.StdOut logger. I cannot figure out why, since I would like
messages to be printed directly from the logger that is receiving them.
It seems like messages are "passing through" loggers, which are ultimately
printed out from the org.apache.nifi.StdOut logger. Here is an example of one
log message:
2022-09-27 10:08:01,849 INFO [NiFi logging handler] org.apache.nifi.StdOut
2022-09-27 10:08:01,848 INFO [pool-6-thread-1]
o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile
Repository
Why would every single log message come from the StdOut logger? And how can I
have logs delivered from the logger they're supposedly originally coming from?
My logback.xml configuration is below for reference.
true
%date %level [%thread] %logger{40} %msg%n
