Re: Writing files to MapR File system using putHDFS

2016-06-13 Thread Sumanth Chinthagunta
I had been using custom build nifi-hadoop-libraries-nar-0.6.1.nar that worked with MapR 4.02 make sure you add java.security.auth.login.config and follow mapR client setup on the NiFi server (https://github.com/xmlking/mapr-nifi-hadoop-libraries-bundle/blob/master/mapr-client.md

Re: Writing files to MapR File system using putHDFS

2016-06-13 Thread Bryan Bende
I'm not sure if this would make a difference, but typically the configuration resources would be the full paths to core-site.xml and hdfs-site.xml. Wondering if using those instead of yarn-site.xml changes anything. On Monday, June 13, 2016, Ravi Papisetti (rpapiset) wrote:

Re: Writing files to MapR File system using putHDFS

2016-06-13 Thread Ravi Papisetti (rpapiset)
Yes, Aldrin. Tried listHDFS, gets the similar error complaining directory doesn't exist. NiFi – 0.6.1 MapR – 5.1 NiFi is local standalone instance. Target cluster is enabled with token based authentication. I am able to execute "hadoop fs –ls " from cli on the node with NiFi installed.

Re: Writing files to MapR File system using putHDFS

2016-06-13 Thread Aldrin Piri
Hi Ravi, Could you provide some additional details in terms of both your NiFi environment and the MapR destination? Is your NiFi a single instance or clustered? In the case of the latter, is security established for your ZooKeeper ensemble? Is your target cluster Kerberized? What version are

Re: Replace Text

2016-06-13 Thread ski n
You can also make your input XML well-formed by creating a custom root element (e.g. ...xmldocuments and then use the SplitXML processor (or just the transformation step). 2016-06-13 18:04 GMT+02:00 Anuj Handa : > i have a text file which has multiple XML documents. which

Re: Replace Text

2016-06-13 Thread Anuj Handa
i have a text file which has multiple XML documents. which starts with wrote: > Awesome, and what processor were you planning to use to split on "#|#|#"? > The SplitContent processor[1] can be used to split the content on a > sequence of text characters which could split on " without needing to

Re: Replace Text

2016-06-13 Thread Joe Percivall
Awesome, and what processor were you planning to use to split on "#|#|#"? The SplitContent processor[1] can be used to split the content on a sequence of text characters which could split on

Best practice: template subdirectory?

2016-06-13 Thread Russell Bateman
What's everybody using as a subdirectory for templates copied over from one's own and other folks' work? Googling, I haven't found any opinions on this. I know that to import a template I can just browse for it, but where are some of you keeping them? Surely there's a smarter place than

Re: Replace Text

2016-06-13 Thread Joe Percivall
Sorry I got a bit confused, in your original question you said that you wanted to append the value and I took it that you just wanted to append the value to the end of the line or text. Let me try and restate your goal so I'm sure I understand, ultimately you want to split the incoming

Re: How to call a stored procedure

2016-06-13 Thread ski n
Thanks for your instructions. Unfortunately I didn't get it working yet. 1) Firstly I want to avoid extra steps like evaluate xpath and replacetext. Would be easier if ${message} or ${file-content} or whatever variable in the expression language is available out-of-the-box (Camel provides this

Re: How to effectively log the data flow in NiFi?

2016-06-13 Thread Mark Payne
Russ, Sorry for the lack of clarity. This change will occur in version 1.0.0. In the 0.x baseline, the log level for processors is set to INFO. Thanks -Mark > On Jun 13, 2016, at 10:37 AM, Russell Bateman > wrote: > > Mark, > > When did this happen?

Re: NoClassDefFoundError: org/slf4j/LoggerFactory

2016-06-13 Thread Dr. Donald Leonhard-MacDonald
Hi Bryan, That’s great to know. That might be easier. Cheers, Donald. > On 13 Jun 2016, at 16:32, Bryan Bende wrote: > > Hi Donald, > > I know this does not directly address the conflict in dependencies, but I > wanted to mention that it is not required to inherit from

Re: Replace Text

2016-06-13 Thread Joe Percivall
Hello, In order to use ReplaceText[1] to solely append a value to the end of then entire text then change the "Replacement Strategy" to "Append" and leave "Evaluation Mode" as "Entire Text". This will take whatever is the "Replacement Value" and append it as a literal(without interpreting

Re: How to effectively log the data flow in NiFi?

2016-06-13 Thread Russell Bateman
Mark, When did this happen? I'm looking at (an as yet unchanged from original download) /co//nf///logback.xml/ in 0.6.1 and I'm seeing: - no string of characters "org.apache.nifi.processors" and - INFO all over in places like level="INFO"/> What am I missing? Was your comment valid

Re: NoClassDefFoundError: org/slf4j/LoggerFactory

2016-06-13 Thread Bryan Bende
Hi Donald, I know this does not directly address the conflict in dependencies, but I wanted to mention that it is not required to inherit from nifi-nar-bundles. The Maven archetype does that by default, but you can certainly remove it, there are some instructions on how to do so here:

Replace Text

2016-06-13 Thread Anuj Handa
Hi, I am trying to read a file and then use replaceText to append a string so I can spilt the line in the next step. I am nable to make the ReplaceText work. The flowfile is going through as success without the string being appended or replaced Any thoughts what i could be doing wrong [image:

NoClassDefFoundError: org/slf4j/LoggerFactory

2016-06-13 Thread Dr. Donald Leonhard-MacDonald
Hi All, First let me say I’m really enjoying using Nifi, it’s a great project. I have been creating some Processors and they are working very well. Now I want to include processors that talk to RethinkDB. When I include the dependency in Maven I get an java.lang.NoClassDefFoundError: