Change data capture processor

Is the new CaptureChangeMySQL processor available in 1.2 and is there any documentation available for this processor? https://issues.apache.org/jira/browse/NIFI-3413 Thanks!

Re: MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

Hello Prabhu, I think you're running into a logback bug [1] that is fixed with 1.1.7. Unfortunately, it looks like NiFi 0.6.1 is using logback 1.1.3. [1] https://jira.qos.ch/browse/LOGBACK-747 On Tue, Apr 11, 2017 at 8:37 AM prabhu Mahendran wrote: > In NiFi-0.6.1 ,i

Re: Logging changes to workflow

John The code i referenced in the previous note on this thread points to the API support for connecting a reporting task to the audit data. This will give you more stable/reliable information than having a Logger send the data via syslog/etc.. However, there is no ReportingTask that I am aware

Re: parsing html

Sven, There is also the GetHTML processor I added awhile back. If the input is valid HTML you should always be able to use a CSS selector to extract that HTML value. If you can provide a sample of the HTML I would be glad to make a flow for you doing so as an example Jeremy Sent from my

Re: parsing html

Sven, Currently I would recommend using ExecuteScript and simply streaming & slicing the content bytes at line 10 (a one-line operation in Groovy, I believe the same in Ruby and Python). This isn’t the first time I’ve heard of a similar request though, so I think if you were to open a Jira

parsing html

I'm looking to parse some HTML. It's not the cleanest but i know that my content is always on line 10 of the file. I could use splittext then compare it to ensure it starts with XYZBeginningString, i supose.. but i'm looking for something w/ less overhead. Especially knowing the content is always

Re: Logging changes to workflow

Hi, It seems such a reporting task is not yet implemented. I wonder if you need only output to syslog, can’t this be configured adding *SyslogAppender* to logback.xml configuration? And maybe new Logger is also needed in logback.xml? Which might be Logger name? Thanks Toivo

Re: How to configure logging via SLF4J ?

Take a look at ${NIFI_ROOT}//conf/logback.xml/. If you've developed a processor and are asking about it, likely this question would fit better in d...@nifi.apache.org, no? Hope this helps. On 04/11/2017 08:24 AM, Vince Cole wrote: Hi I have developed a processor which uses

How to configure logging via SLF4J ?

Hi I have developed a processor which uses qpid-jms-client to send messages to ActiveMQ. The jms client uses SLF4J and I need to configure that via NIFI... how? Thanks

Re: Location for script using ExecuteStreamCommand

We also keep all our files including scripts that are specific to our NiFi installation in a Git project. On Tue, Apr 11, 2017 at 9:49 AM, James McMahon wrote: > Good morning Jennifer. We have been working with NiFi for only a year and > so can only offer you that level of

Re: Location for script using ExecuteStreamCommand

Good morning Jennifer. We have been working with NiFi for only a year and so can only offer you that level of "hands on" experience. With that in mind, we established a scripts subdirectory at the same level as the NiFi config, logs, etc. This does mean that we must make migrating that folder part

Re: Location for script using ExecuteStreamCommand

Hi Jennifer, I would think that for a script of moderate or more complexity, having it versioned (git, svn, etc) would be useful. Also, it should definitely not be writable by users other than (and possibly including) NiFi as it could be modified to do something malicious. Thanks, Bryan On

Location for script using ExecuteStreamCommand

Is there a best practice for where to store scripts used by ExecuteStreamCommand processors? Jennifer Tress

MaxFileSize in timeBasedFileNamingAndTriggeringPolicy not work?

In NiFi-0.6.1 ,i have try to reduce size of nifi-app.log to be stored in local directory. In that conf\logback.xml i have configured "MaxFileSize" to be 1MB.I think this only stores nifi-app.log should be under 1 MB Size only.But it doesn't do like that.It always store every logs.

RE: GetHDFS from Azure Blob

Hi Bryan, That indeed did the trick (2.8.0 has been out for a while). All the tests passed. For future reference, and for anybody trying this on a HDInsight managed node, this is what I had to do Create a wasb-site.xml with inside the following fs.wasb.impl

RE: Logging changes to workflow

Hi Joe, What is meant by the following statement: "From that one can access the list of changes from a given offset onward." ReportingTask.java is an interface class. That does mean there exists a class specifically for reporting configuration changes? Regards John -Original Message-