Need Help with zookeeper

2020-03-30 Thread gaurav jain
Hi I am a noob here and have been given a the task for nifi with zookeeper set up on the same machine and I am unable to wrap my head around it. Can someone share some resources or exact set up as to how to do so. Thanks and Kind Regards Gaurav Jain crazcu...@gmail.com

Re: Need Help with zookeeper

2020-03-30 Thread Marton Szasz
Hi. Zookeeper: Typically distribution packages work fine. I've installed zookeeper and zookeeperd packages on debian. If this is not preferred, here's zookeeper's getting started guide: https://zookeeper.apache.org/doc/r3.6.0/zookeeperStarted.html Nifi: See "Getting Started" at http://nifi.apache

Help hiveputstreaming

2020-03-30 Thread JoNeS JJ
Hi Team, I need some more clarification on this. My configuration is below, Heartbeat Interval : 60 Transaction per Batch : 100 Records per Transaction : 1 Call Timeout: 0 Here my question is below, 1. If we reached 1 records then only it will update into hive table?? Till then it will

Re: Need Help with zookeeper

2020-03-30 Thread Chad Zobrisky
Guarav, Nifi has Zookeeper embedded, so if an external zookeeper is not required you may be able to use the embedded one? There are pros and cons for both sides that I think are touched on in the Nifi documentation. Best of luck, Chad On Mon, Mar 30, 2020 at 8:09 AM Marton Szasz wrote: > Hi. >

Re: Reading the incoming flowfile "twice"

2020-03-30 Thread Russell Bateman
If I haven't worn out my welcome, here is the simplified code that should demonstrate either that I have miscoded your suggestions or that the API doesn't in fact work as advertised. First, the output. The code, both JUnit test and processor are attached and the files are pretty small. Much th

Re: Reading the incoming flowfile "twice"

2020-03-30 Thread Otto Fowler
Can I ask why you would consume the whole stream when doing the non-sax part? If you consume the stream right up to the sax part ( the stream POS is at the start of the xml ) then you can just pass the stream to sax as is can’t you? On March 30, 2020 at 16:23:27, Russell Bateman (r...@windofkel