Bryan – Thanks – I am trying to setup site-to-site.
I have two slaves and one NCM.
My properties as follows :
On both Slaves:
nifi.remote.input.socket.port=10880
nifi.remote.input.secure=false
On NCM:
nifi.remote.input.socket.port=10880
nifi.remote.input.secure=false
When I try drop remote pro
Hi,
I'm just getting started with Nifi and understand that I probably still
have some misconceptions :)
For various reasons I'd love to use NiFi for one-time actions/processors
which I'd like to trigger as needed from the UI. I've seen the various
scheduling strategies and the closest I've come i
Lars,
First, welcome to NiFi.
So you'll initiate the flow from NiFi through some manual trigger and
that part makes sense/sounds straightforward. But then the question
is 'once the flow is done' I'd like it to shut down. What are the
processors/things that begin the flow? We've recently had so
I was able to get site-to-site work.
I tried to follow your instructions to send data distribute across the nodes.
GenerateFlowFile (On Primary) —> RPG
RPG —> Input Port —> Putfile (Time driven scheduling)
However, data is only written to one slave (Secondary slave). Primary slave has
not data
Chakri,
Would love to hear what you've learned and how that differed from the
docs themselves. Site-to-site has proven difficult to setup so we're
clearly not there yet in having the right operator/admin experience.
Thanks
Joe
On Sun, Jan 10, 2016 at 3:41 PM, Chakrader Dewaragatla
wrote:
> I w
Joe,
thanks for the welcome and the (really quick) reply.
My use-case (and again I may use NiFi for things it wasn't intended to) is
for a one-time/initial-import scenario. I have a Processor that I'd like to
start that then calls a Web service and pages through all results creating
FlowFiles and
Chakri,
Glad you got site-to-site working.
Regarding the data distribution, I'm not sure why it is behaving that way.
I just did a similar test running ncm, node1, and node2 all on my local
machine, with GenerateFlowFile running every 10 seconds, and Input Port
going to a LogAttribute, and I see
Bryan – Here are the logs :
I have 5 sec flow file.
On primary node (No data coming in)
2016-01-10 22:52:36,322 INFO [Clustering Tasks Thread-1]
org.apache.nifi.cluster.heartbeat Heartbeat created at 2016-01-10 22:52:36,146
and sent at 2016-01-10 22:52:36,322; send took 0 millis
2016-01-10 22
Hi,
I have a json array flowfile and would like to sort the json array by
some certain value (let’s say price). Is it possible sort json array within
nifi dataflow? I have tried EvaluateJsonPath processor, but jsonpath doesn’t
support sort syntax. I still can’t figure it out how to do th
Hello Roland
I don't believe we have out of the box support for that but it would
make for likely a well scoped custom processor.
You mention support for sort syntax. Can you share what that might look like?
Thanks
Joe
On Sun, Jan 10, 2016 at 9:45 PM, 彭光裕 wrote:
> Hi,
>
> I have a jso
Thank you Joe.
Sqoop to HDFS data load is outside the NiFi flow. Once the data is pushed
to HDFS then I have to process each record and perform validations.
By Validation i meant that we will be picking a particular column for each
record store in HDFS and the performing a SQL query against anoth
Hello Joe,
Thanks for your response.
You can refer to http://www.trentrichardson.com/jsonsql/ for more
details about what I've mentioned.
Besides that, http://doc.snaplogic.com/jsonpath , this project also
extends jsonpath for more functions something like sort,etc.
12 matches
Mail list logo
