Re: Need help in nifi- flume processor

Hi, Thank you very much for all the support. I could able to convert XML format to json using custom flume source. Now I would need ConvertJSONToSQL processor to insert data into SQL. I am trying to get hands-on on this processor. Will update you on this. Meanwhile if any example you could

Custom classpath (using MapR-FS in lieu of HDFS)

Hi there, First post in here so please... you know the drill. I was wondering: What is the recommended approach to add custom classes to NiFi on load time? Reason I ask is simple: Our HDFS store is in fact a MapR-FS store and as such I need to use the proprietary MapR client and Hadoop JARs on

Re: Custom classpath (using MapR-FS in lieu of HDFS)

May be I am missing certain details, but are you asking about custom bundle (NAR) or using existing NiFi bundles which would somehow have to delegate to some custom JARs? I am thinking that if you are using custom client, you may need a custom bundle. Oleg > On Oct 12, 2015, at 9:29 AM, Andre

Re: Custom classpath (using MapR-FS in lieu of HDFS)

Joe, Epic! Exactly what I was looking for. (Also, apologies for getting you to LMGTFY... :-) ) Cheers On Tue, Oct 13, 2015 at 1:13 AM, Joe Witt wrote: > Hello Andre, > > Found on Github here is someone who already got NiFi working with MapR > and documented their approach.

Re: Custom classpath (using MapR-FS in lieu of HDFS)

Epic is your google profile picture. No problem - we're here to help. For the Hadoop distros we just need to make it easy for folks to interact with their distro of choice. You should be able to drag the HDFS processors onto the graph and select 'distro/provider','version', etc.. and go to

Re: Custom classpath (using MapR-FS in lieu of HDFS)

Hello Andre, Found on Github here is someone who already got NiFi working with MapR and documented their approach. https://github.com/bbukacek/nifi-hadoop-libraries-bundle Thanks Joe On Mon, Oct 12, 2015 at 9:46 AM, Oleg Zhurakousky wrote: > May be I am missing

Re: Need help in nifi- flume processor

I think ConvertJSONToSQL expects a flat document of key/value pairs, or an array of flat documents. So I think your JSON would be: [ {"firstname":"John", "lastname":"Doe"}, {"firstname":"Anna", "lastname":"Smith"} ] The table name will come from the Table Name property. Let us know if

Put to update a processor (REST API)

I'm trying to do a put to update a GetTwitter Processor, I want to set the Consumer & Access Token Secret. Doing the follow put with application/json always gives me a 400 error. This is the put body: { "revision": { "version": 0, "lastModifier": "value" }, "processor": {

site to site setup - Remore instance not configured

Hi – I have a use case to collect http post requests on a nifi-clustered setup. My cluster has three nodes. Ncm —> Slave 1 (Primary) —> Slave 2. I would like to setup a http listener on primary node and establish site to site connection to the same cluster for further processing data.

Re: site to site setup - Remore instance not configured

For Site to Site properties the input socket host is optional. When it is configured it should be set the hostname or IP of the the system the NiFi instance is running on. you must however configure an input socket port on every instance. This includes all nodes and the NCM. If you cluster is

Re: Put to update a processor (REST API)

Devin, Within the config you need specify "properties". { "revision": { "version": 0, "lastModifier": "value" }, "processor": { "config": { "properties": { "Consumer Secret": "xxx", "Access Token Secret": "xxx"