I am researching to implement Change Data Capture(CDC) solution by observing
MySQL binlogs and routing that data through NiFi to detect inserts , updates
and deletes and finally storing/sync the data into NoSQL(MongoDB) and HDFS.
For this use case the data in source system is normalized (OLTP)
How about maintaining a registry like npm https://www.npmjs.com or
https://github.com/jspm/registry where individuals host their modules on github
and users can discover them via registry?
Sent from my iPad
> On Nov 1, 2015, at 10:35 AM, Joe Witt wrote:
>
> " but raises several questions, al
In nodejs/npm world, each module has package.json, which declaratively indicate
which node version and other external modules it depends on.
Similarly I am thinking Nar modules can declare which version of JVM and NiFi
it depends on and also which other modules it depends on. NPM ( NiFi Package
May be we can create getKafka2 for 0.9.0.0, leaving original form backward
compatibility.
I will try new consumer API tomorrow and share here.
My concern with old consumer API is, it depends on zookeeper and worried, I
may have to open multiple ports on firewall as described here
http://mai
Thanks Richard.
I will test it tomorrow.
Sumo
Sent from my iPad
> On Dec 21, 2015, at 11:25 PM, Richard Miskin wrote:
>
> Hi Sumanth,
>
> I think you need to assign the return of putAllAttributes() to ff. A new
> FlowFile is created as part of that call.
>
> Cheers,
> Richard
>
> On Tuesday,
Some open source projects are using Hazelcast's distributed map for state
management.
It provides standard Java map API.
http://docs.hazelcast.org/docs/3.5/manual/html/map.html
Sumo
Sent from my iPad
> On Jan 11, 2016, at 5:37 AM, Mark Payne wrote:
>
> In case any of you are following along h
I have an usecase where I have to pull some configuration files from Git
repository and store them into a server directory, whenever files are updated
via webhooks.[automated deployment]
Checking if anybody build custom processor to pull files from Git.
By the way, it would be nice if NiFi UI d
Was planing to upgrade my websocket processor/controller to 0.5.1.
Just checking, so that I don't have to build if controller scripting is in
roadmap, Nothing important
Thanks
Sumo
> On Feb 20, 2016, at 10:40 AM, Joe Witt wrote:
>
> Hello Sumo
>
> https://issues.apache.org/jira/browse/N
