MQTT can function in its own right outside of Site to Site and MiNiFi could
support that using processors.
A bit of time ago, I made NIFI-1820 [1] which can be notionally summed up
as being "extend Site to Site with caveats depending on backing protocol."
Conceptually, I like what this could
Yeah I think the HTTP approach is fine for my use case where the number of
"satellites" is limited.
However, we can extend this discussion to the IoT use case where satellites
are MiNiFi agents and where the number of agents is thousands or more. In
that case the HTTP approach won't scale and I
Echoing Mark's advice, we have a "star deployment" and use InvokeHttp with
EL to send requests back "out.
For the addition of PUB/SUB to S2S, I'd be wary of scope creep. PUB/SUB has
entire Apache projects dedicated to getting it right.
Joe
On Sun, Sep 16, 2018 at 3:29 PM Ed B wrote:
> Pierre,
Pierre, Mark,
Although I agree it is possible to work it around with HTTP
(Post/Listen/Invoke), I still think that PUB/SUB for S2S (regardless it is
on the same cluster or different ones) worth discussion and implementation.
That would make implementation more natural and mature.
Pierre, don't
Hi Mark,
Thanks for the answer. You're right, I was going to use
ProcessSession.get(FlowFileFilter);
And I considered that I would set an expiration date on the flow file in
case a standalone instance is not pulling data to ensure that the queue is
not filling up. But I didn't think about the
Hey Pierre,
I'm not sure that this is the best route to go down. There are a couple of
problems that I think
you will run into. The most important will be what happens when the data going
to that Output Port
queues up into a large queue? If a NiFi instance then requests data, I presume
that
Hi all,
Here is my use case: I've multiple NiFi standalone instances deployed over
multiple sites (that could be MiNiFi instances) and a central NiFi
cluster. The standalone instances generate data, the data is sent to the
central cluster to be parsed and enriched before being sent back to the
